[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 20:11:16.418794 400 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.100.62:40261
I20240501 20:11:16.420348 400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 20:11:16.421636 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:16.432760 408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:16.432798 405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:16.433507 406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:16.434036 400 server_base.cc:1034] running on GCE node
I20240501 20:11:16.434783 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:16.434954 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:16.435029 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594276435009 us; error 0 us; skew 500 ppm
I20240501 20:11:16.435338 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:16.437795 400 webserver.cc:460] Webserver started at http://127.0.100.62:40563/ using document root <none> and password file <none>
I20240501 20:11:16.438514 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:16.438607 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:16.438936 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:16.443035 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/master-0-root/instance:
uuid: "f493f2681f0a465287b8e41af7ac2c16"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.448509 400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20240501 20:11:16.451979 413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.453342 400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20240501 20:11:16.453500 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/master-0-root
uuid: "f493f2681f0a465287b8e41af7ac2c16"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.453666 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:16.479995 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:16.481304 400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 20:11:16.481585 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:16.499501 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.62:40261
I20240501 20:11:16.499508 464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.62:40261 every 8 connection(s)
I20240501 20:11:16.504431 465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.517251 465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16: Bootstrap starting.
I20240501 20:11:16.521384 465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:16.522523 465 log.cc:824] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16: Log is configured to *not* fsync() on all Append() calls
I20240501 20:11:16.525151 465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16: No bootstrap required, opened a new log
I20240501 20:11:16.532117 465 raft_consensus.cc:348] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493f2681f0a465287b8e41af7ac2c16" member_type: VOTER }
I20240501 20:11:16.532493 465 raft_consensus.cc:374] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:16.532629 465 raft_consensus.cc:729] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f493f2681f0a465287b8e41af7ac2c16, State: Initialized, Role: FOLLOWER
I20240501 20:11:16.533452 465 consensus_queue.cc:260] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493f2681f0a465287b8e41af7ac2c16" member_type: VOTER }
I20240501 20:11:16.533679 465 raft_consensus.cc:388] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 20:11:16.533802 465 raft_consensus.cc:482] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 20:11:16.533954 465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:16.535938 465 raft_consensus.cc:504] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493f2681f0a465287b8e41af7ac2c16" member_type: VOTER }
I20240501 20:11:16.536432 465 leader_election.cc:302] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f493f2681f0a465287b8e41af7ac2c16; no voters:
I20240501 20:11:16.537012 465 leader_election.cc:288] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 20:11:16.537153 468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:16.538225 468 raft_consensus.cc:686] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 1 LEADER]: Becoming Leader. State: Replica: f493f2681f0a465287b8e41af7ac2c16, State: Running, Role: LEADER
I20240501 20:11:16.538741 468 consensus_queue.cc:237] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493f2681f0a465287b8e41af7ac2c16" member_type: VOTER }
I20240501 20:11:16.539144 465 sys_catalog.cc:564] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 20:11:16.541532 470 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f493f2681f0a465287b8e41af7ac2c16. Latest consensus state: current_term: 1 leader_uuid: "f493f2681f0a465287b8e41af7ac2c16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493f2681f0a465287b8e41af7ac2c16" member_type: VOTER } }
I20240501 20:11:16.541838 470 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [sys.catalog]: This master's current role is: LEADER
I20240501 20:11:16.542115 469 sys_catalog.cc:455] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f493f2681f0a465287b8e41af7ac2c16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f493f2681f0a465287b8e41af7ac2c16" member_type: VOTER } }
I20240501 20:11:16.542330 469 sys_catalog.cc:458] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [sys.catalog]: This master's current role is: LEADER
I20240501 20:11:16.543318 476 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 20:11:16.548527 476 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 20:11:16.550611 400 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 20:11:16.558691 476 catalog_manager.cc:1347] Generated new cluster ID: 10229d8b59c74826932e13f162f9d1ac
I20240501 20:11:16.558815 476 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 20:11:16.581799 476 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 20:11:16.584139 476 catalog_manager.cc:1504] Loading token signing keys...
I20240501 20:11:16.603082 476 catalog_manager.cc:5857] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16: Generated new TSK 0
I20240501 20:11:16.604452 476 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 20:11:16.616106 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:16.620374 487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:16.622253 488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:16.622359 490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:16.623036 400 server_base.cc:1034] running on GCE node
I20240501 20:11:16.623337 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:16.623417 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:16.623486 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594276623454 us; error 0 us; skew 500 ppm
I20240501 20:11:16.623670 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:16.625124 400 webserver.cc:460] Webserver started at http://127.0.100.1:42785/ using document root <none> and password file <none>
I20240501 20:11:16.625381 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:16.625453 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:16.625608 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:16.626277 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-0-root/instance:
uuid: "dadc37f905e3414782d795171cd11105"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.628988 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:11:16.630795 495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.631217 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 20:11:16.631850 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-0-root
uuid: "dadc37f905e3414782d795171cd11105"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.632004 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:16.647329 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:16.648666 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:16.649670 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:11:16.651387 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:11:16.651538 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.651667 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:11:16.651751 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.671948 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.1:40163
I20240501 20:11:16.671965 557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.1:40163 every 8 connection(s)
I20240501 20:11:16.674381 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:16.691871 563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:16.693562 560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:16.696722 565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:16.703497 400 server_base.cc:1034] running on GCE node
I20240501 20:11:16.704059 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:16.704146 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:16.704212 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594276704171 us; error 0 us; skew 500 ppm
I20240501 20:11:16.704396 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:16.706701 400 webserver.cc:460] Webserver started at http://127.0.100.2:38713/ using document root <none> and password file <none>
I20240501 20:11:16.706988 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:16.707118 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:16.707149 558 heartbeater.cc:347] Connected to a master server at 127.0.100.62:40261
I20240501 20:11:16.707242 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:16.707511 558 heartbeater.cc:464] Registering TS with master...
I20240501 20:11:16.707886 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-1-root/instance:
uuid: "5610b9abb5254acbafe12918f369617e"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.708461 558 heartbeater.cc:511] Master 127.0.100.62:40261 requested a full tablet report, sending...
I20240501 20:11:16.711232 430 ts_manager.cc:194] Registered new tserver with Master: dadc37f905e3414782d795171cd11105 (127.0.100.1:40163)
I20240501 20:11:16.713708 430 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48044
I20240501 20:11:16.713972 400 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20240501 20:11:16.716064 570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.716444 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 20:11:16.716562 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-1-root
uuid: "5610b9abb5254acbafe12918f369617e"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.716701 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:16.751678 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:16.752727 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:16.753407 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:11:16.754418 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:11:16.754514 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.754632 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:11:16.754690 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.774094 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.2:36017
I20240501 20:11:16.774127 632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.2:36017 every 8 connection(s)
I20240501 20:11:16.776046 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:16.779361 636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:16.784296 637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:16.789821 633 heartbeater.cc:347] Connected to a master server at 127.0.100.62:40261
I20240501 20:11:16.789984 633 heartbeater.cc:464] Registering TS with master...
I20240501 20:11:16.790583 633 heartbeater.cc:511] Master 127.0.100.62:40261 requested a full tablet report, sending...
I20240501 20:11:16.791692 430 ts_manager.cc:194] Registered new tserver with Master: 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:16.792699 400 server_base.cc:1034] running on GCE node
I20240501 20:11:16.792797 430 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48046
W20240501 20:11:16.793679 639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:16.794023 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:16.794114 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:16.794173 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594276794149 us; error 0 us; skew 500 ppm
I20240501 20:11:16.794327 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:16.795737 400 webserver.cc:460] Webserver started at http://127.0.100.3:36849/ using document root <none> and password file <none>
I20240501 20:11:16.795984 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:16.796069 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:16.796206 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:16.796855 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-2-root/instance:
uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.799933 400 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240501 20:11:16.801734 644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.802137 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 20:11:16.802273 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-2-root
uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
format_stamp: "Formatted at 2024-05-01 20:11:16 on dist-test-slave-hhxv"
I20240501 20:11:16.802409 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714594276349076-400-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:16.828425 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:16.829169 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:16.829896 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:11:16.831441 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:11:16.831548 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.831651 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:11:16.831732 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:16.852656 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.3:40905
I20240501 20:11:16.852676 706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.3:40905 every 8 connection(s)
I20240501 20:11:16.862140 707 heartbeater.cc:347] Connected to a master server at 127.0.100.62:40261
I20240501 20:11:16.862293 707 heartbeater.cc:464] Registering TS with master...
I20240501 20:11:16.862768 707 heartbeater.cc:511] Master 127.0.100.62:40261 requested a full tablet report, sending...
I20240501 20:11:16.863716 430 ts_manager.cc:194] Registered new tserver with Master: ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:16.864271 400 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.010307212s
I20240501 20:11:16.864516 430 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48058
I20240501 20:11:16.866268 400 test_util.cc:268] Using random seed: 382630075
I20240501 20:11:16.892397 430 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48070:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 20:11:16.895228 430 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 20:11:16.933988 523 tablet_service.cc:1467] Processing CreateTablet for tablet 01e9dabeca4843cf9c62c5b85c676eab (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 20:11:16.935451 520 tablet_service.cc:1467] Processing CreateTablet for tablet 35802f0e6f7b46c89d30a69a86b72d7d (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 20:11:16.935031 521 tablet_service.cc:1467] Processing CreateTablet for tablet c2bd5e66b57b44dab99e935910c30ebb (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 20:11:16.936781 523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e9dabeca4843cf9c62c5b85c676eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.943156 520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35802f0e6f7b46c89d30a69a86b72d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.943271 522 tablet_service.cc:1467] Processing CreateTablet for tablet 780cb8fe58324c80a31ca93e2dc76975 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 20:11:16.944159 521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2bd5e66b57b44dab99e935910c30ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.949934 518 tablet_service.cc:1467] Processing CreateTablet for tablet eebf179fe3f24593b357e64b8bcf66c9 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 20:11:16.953516 522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780cb8fe58324c80a31ca93e2dc76975. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.955089 518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eebf179fe3f24593b357e64b8bcf66c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.952948 519 tablet_service.cc:1467] Processing CreateTablet for tablet 5366ac20e74b4e9a886754037bf78bac (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 20:11:16.956589 517 tablet_service.cc:1467] Processing CreateTablet for tablet 10085ca24ddb4d5098b7abd0e5d5eb25 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 20:11:16.957509 519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5366ac20e74b4e9a886754037bf78bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.957484 515 tablet_service.cc:1467] Processing CreateTablet for tablet bd7882a099d4410bb0664b9ff201a257 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 20:11:16.958284 516 tablet_service.cc:1467] Processing CreateTablet for tablet 3accccf29b0f42f29ccf26445c9c24a9 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 20:11:16.960587 722 tablet_bootstrap.cc:492] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:16.960747 517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10085ca24ddb4d5098b7abd0e5d5eb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.961395 515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd7882a099d4410bb0664b9ff201a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.962111 516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3accccf29b0f42f29ccf26445c9c24a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.992920 672 tablet_service.cc:1467] Processing CreateTablet for tablet 01e9dabeca4843cf9c62c5b85c676eab (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 20:11:16.994163 722 tablet_bootstrap.cc:654] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:16.994158 672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e9dabeca4843cf9c62c5b85c676eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.992727 671 tablet_service.cc:1467] Processing CreateTablet for tablet 780cb8fe58324c80a31ca93e2dc76975 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 20:11:16.995483 671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780cb8fe58324c80a31ca93e2dc76975. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.995519 667 tablet_service.cc:1467] Processing CreateTablet for tablet eebf179fe3f24593b357e64b8bcf66c9 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 20:11:16.995483 665 tablet_service.cc:1467] Processing CreateTablet for tablet 3accccf29b0f42f29ccf26445c9c24a9 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 20:11:16.995792 670 tablet_service.cc:1467] Processing CreateTablet for tablet c2bd5e66b57b44dab99e935910c30ebb (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 20:11:16.996877 669 tablet_service.cc:1467] Processing CreateTablet for tablet 35802f0e6f7b46c89d30a69a86b72d7d (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 20:11:16.997220 667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eebf179fe3f24593b357e64b8bcf66c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.996098 666 tablet_service.cc:1467] Processing CreateTablet for tablet 10085ca24ddb4d5098b7abd0e5d5eb25 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 20:11:16.998162 670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2bd5e66b57b44dab99e935910c30ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:16.999078 664 tablet_service.cc:1467] Processing CreateTablet for tablet bd7882a099d4410bb0664b9ff201a257 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 20:11:16.999617 668 tablet_service.cc:1467] Processing CreateTablet for tablet 5366ac20e74b4e9a886754037bf78bac (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 20:11:17.000993 665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3accccf29b0f42f29ccf26445c9c24a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.005200 668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5366ac20e74b4e9a886754037bf78bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.006107 666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10085ca24ddb4d5098b7abd0e5d5eb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.006928 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35802f0e6f7b46c89d30a69a86b72d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.007822 664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd7882a099d4410bb0664b9ff201a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.040058 722 tablet_bootstrap.cc:492] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.040272 722 ts_tablet_manager.cc:1367] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.082s user 0.012s sys 0.019s
I20240501 20:11:17.041764 722 raft_consensus.cc:348] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.042037 722 raft_consensus.cc:374] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.042140 722 raft_consensus.cc:729] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.042408 722 consensus_queue.cc:260] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.043815 724 tablet_bootstrap.cc:492] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.045943 558 heartbeater.cc:503] Master 127.0.100.62:40261 was elected leader, sending a full tablet report...
I20240501 20:11:17.049110 594 tablet_service.cc:1467] Processing CreateTablet for tablet 5366ac20e74b4e9a886754037bf78bac (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 20:11:17.049516 722 ts_tablet_manager.cc:1398] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20240501 20:11:17.049877 722 tablet_bootstrap.cc:492] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.050420 598 tablet_service.cc:1467] Processing CreateTablet for tablet 01e9dabeca4843cf9c62c5b85c676eab (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 20:11:17.051599 597 tablet_service.cc:1467] Processing CreateTablet for tablet 780cb8fe58324c80a31ca93e2dc76975 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 20:11:17.050750 591 tablet_service.cc:1467] Processing CreateTablet for tablet 3accccf29b0f42f29ccf26445c9c24a9 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 20:11:17.052210 594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5366ac20e74b4e9a886754037bf78bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.051692 592 tablet_service.cc:1467] Processing CreateTablet for tablet 10085ca24ddb4d5098b7abd0e5d5eb25 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 20:11:17.051865 593 tablet_service.cc:1467] Processing CreateTablet for tablet eebf179fe3f24593b357e64b8bcf66c9 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 20:11:17.053175 598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e9dabeca4843cf9c62c5b85c676eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.053282 590 tablet_service.cc:1467] Processing CreateTablet for tablet bd7882a099d4410bb0664b9ff201a257 (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 20:11:17.055573 597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 780cb8fe58324c80a31ca93e2dc76975. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.054570 596 tablet_service.cc:1467] Processing CreateTablet for tablet c2bd5e66b57b44dab99e935910c30ebb (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 20:11:17.054543 595 tablet_service.cc:1467] Processing CreateTablet for tablet 35802f0e6f7b46c89d30a69a86b72d7d (DEFAULT_TABLE table=test-workload [id=c50d6d6c76bf4f00872c5f65b5194352]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 20:11:17.056663 590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd7882a099d4410bb0664b9ff201a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.057227 595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35802f0e6f7b46c89d30a69a86b72d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.057839 593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eebf179fe3f24593b357e64b8bcf66c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.057893 724 tablet_bootstrap.cc:654] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.059948 722 tablet_bootstrap.cc:654] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.060143 596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2bd5e66b57b44dab99e935910c30ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.060602 591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3accccf29b0f42f29ccf26445c9c24a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.061972 592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10085ca24ddb4d5098b7abd0e5d5eb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:17.078505 727 tablet_bootstrap.cc:492] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.080591 727 tablet_bootstrap.cc:654] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.104693 727 tablet_bootstrap.cc:492] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.104864 724 tablet_bootstrap.cc:492] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.104986 722 tablet_bootstrap.cc:492] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.105016 724 ts_tablet_manager.cc:1367] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.010s
I20240501 20:11:17.105019 727 ts_tablet_manager.cc:1367] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.011s
I20240501 20:11:17.105262 722 ts_tablet_manager.cc:1367] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.055s user 0.008s sys 0.025s
I20240501 20:11:17.106106 724 raft_consensus.cc:348] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.106086 722 raft_consensus.cc:348] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.106345 724 raft_consensus.cc:374] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.106369 722 raft_consensus.cc:374] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.106933 722 raft_consensus.cc:729] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.106941 724 raft_consensus.cc:729] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.107254 722 consensus_queue.cc:260] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.107251 724 consensus_queue.cc:260] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.107856 722 ts_tablet_manager.cc:1398] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 20:11:17.108191 722 tablet_bootstrap.cc:492] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.109133 727 raft_consensus.cc:348] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.109330 727 raft_consensus.cc:374] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.109436 727 raft_consensus.cc:729] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.109666 727 consensus_queue.cc:260] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.110133 722 tablet_bootstrap.cc:654] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.113653 633 heartbeater.cc:503] Master 127.0.100.62:40261 was elected leader, sending a full tablet report...
I20240501 20:11:17.114178 707 heartbeater.cc:503] Master 127.0.100.62:40261 was elected leader, sending a full tablet report...
I20240501 20:11:17.116562 724 ts_tablet_manager.cc:1398] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.011s user 0.000s sys 0.008s
I20240501 20:11:17.116911 724 tablet_bootstrap.cc:492] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.117074 727 ts_tablet_manager.cc:1398] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20240501 20:11:17.117362 727 tablet_bootstrap.cc:492] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.118983 724 tablet_bootstrap.cc:654] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.119098 727 tablet_bootstrap.cc:654] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.120468 722 tablet_bootstrap.cc:492] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.120628 722 ts_tablet_manager.cc:1367] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20240501 20:11:17.121533 722 raft_consensus.cc:348] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.121762 722 raft_consensus.cc:374] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.121857 722 raft_consensus.cc:729] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.122098 722 consensus_queue.cc:260] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.122788 722 ts_tablet_manager.cc:1398] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:17.123100 722 tablet_bootstrap.cc:492] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.126488 722 tablet_bootstrap.cc:654] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.126950 725 raft_consensus.cc:482] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.127131 725 raft_consensus.cc:504] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.129871 725 leader_election.cc:288] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.146401 724 tablet_bootstrap.cc:492] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.147576 724 ts_tablet_manager.cc:1367] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.014s
I20240501 20:11:17.146401 727 tablet_bootstrap.cc:492] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.148522 727 ts_tablet_manager.cc:1367] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.018s
I20240501 20:11:17.148471 724 raft_consensus.cc:348] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.148718 724 raft_consensus.cc:374] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.148799 724 raft_consensus.cc:729] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.148762 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.149092 724 consensus_queue.cc:260] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.149304 727 raft_consensus.cc:348] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.149487 727 raft_consensus.cc:374] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.149571 727 raft_consensus.cc:729] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.149652 724 ts_tablet_manager.cc:1398] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:11:17.149897 727 consensus_queue.cc:260] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
W20240501 20:11:17.150151 497 leader_election.cc:341] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.150650 724 tablet_bootstrap.cc:492] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.146813 722 tablet_bootstrap.cc:492] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.151228 722 ts_tablet_manager.cc:1367] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20240501 20:11:17.152069 722 raft_consensus.cc:348] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.152379 724 tablet_bootstrap.cc:654] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.152477 722 raft_consensus.cc:374] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.153028 722 raft_consensus.cc:729] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.153396 722 consensus_queue.cc:260] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.154109 722 ts_tablet_manager.cc:1398] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 20:11:17.155411 727 ts_tablet_manager.cc:1398] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:11:17.156469 724 tablet_bootstrap.cc:492] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.156612 724 ts_tablet_manager.cc:1367] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20240501 20:11:17.157104 727 tablet_bootstrap.cc:492] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.157441 724 raft_consensus.cc:348] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.157637 724 raft_consensus.cc:374] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.157735 724 raft_consensus.cc:729] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.158746 727 tablet_bootstrap.cc:654] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.159021 722 tablet_bootstrap.cc:492] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.158974 724 consensus_queue.cc:260] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.159665 724 ts_tablet_manager.cc:1398] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:11:17.160411 724 tablet_bootstrap.cc:492] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.161497 722 tablet_bootstrap.cc:654] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.156186 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" is_pre_election: true
W20240501 20:11:17.162540 497 leader_election.cc:341] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.163120 724 tablet_bootstrap.cc:654] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.163022 497 leader_election.cc:302] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dadc37f905e3414782d795171cd11105; no voters: 5610b9abb5254acbafe12918f369617e, ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:17.163583 725 raft_consensus.cc:2726] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:11:17.171041 730 raft_consensus.cc:482] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.171207 730 raft_consensus.cc:504] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.172101 727 tablet_bootstrap.cc:492] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.172245 727 ts_tablet_manager.cc:1367] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.001s
I20240501 20:11:17.172217 730 leader_election.cc:288] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.173067 727 raft_consensus.cc:348] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.173270 727 raft_consensus.cc:374] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.173355 727 raft_consensus.cc:729] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.173604 727 consensus_queue.cc:260] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
W20240501 20:11:17.174506 559 tablet.cc:2369] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 20:11:17.176923 727 ts_tablet_manager.cc:1398] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240501 20:11:17.179055 727 tablet_bootstrap.cc:492] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.180730 727 tablet_bootstrap.cc:654] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.182281 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.182655 533 raft_consensus.cc:2454] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 0.
I20240501 20:11:17.184666 648 leader_election.cc:302] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.184793 724 tablet_bootstrap.cc:492] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.184980 724 ts_tablet_manager.cc:1367] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.006s
I20240501 20:11:17.185132 730 raft_consensus.cc:2781] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.185258 730 raft_consensus.cc:482] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.185346 730 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.185827 724 raft_consensus.cc:348] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.186075 724 raft_consensus.cc:374] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.186149 724 raft_consensus.cc:729] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.186483 724 consensus_queue.cc:260] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.188455 730 raft_consensus.cc:504] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.189760 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.189954 533 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.193214 533 raft_consensus.cc:2454] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 1.
I20240501 20:11:17.193746 648 leader_election.cc:302] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.197484 730 leader_election.cc:288] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.198423 730 raft_consensus.cc:2781] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.206977 730 raft_consensus.cc:686] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:17.207402 730 consensus_queue.cc:237] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.219246 722 tablet_bootstrap.cc:492] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.219441 722 ts_tablet_manager.cc:1367] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.061s user 0.032s sys 0.027s
I20240501 20:11:17.220326 722 raft_consensus.cc:348] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.220577 722 raft_consensus.cc:374] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.220687 722 raft_consensus.cc:729] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.220958 722 consensus_queue.cc:260] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.224064 722 ts_tablet_manager.cc:1398] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240501 20:11:17.226750 722 tablet_bootstrap.cc:492] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.228770 722 tablet_bootstrap.cc:654] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.231030 744 raft_consensus.cc:482] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.231276 744 raft_consensus.cc:504] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.232254 744 leader_election.cc:288] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.232496 744 raft_consensus.cc:482] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.232760 744 raft_consensus.cc:504] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.234797 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.235042 533 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 0.
I20240501 20:11:17.235594 648 leader_election.cc:302] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.237012 722 tablet_bootstrap.cc:492] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.237208 722 ts_tablet_manager.cc:1367] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20240501 20:11:17.237991 722 raft_consensus.cc:348] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.238195 722 raft_consensus.cc:374] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.238287 722 raft_consensus.cc:729] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.238554 722 consensus_queue.cc:260] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.238653 430 catalog_manager.cc:5484] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 1 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:17.241032 746 raft_consensus.cc:2781] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.241149 746 raft_consensus.cc:482] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.241257 746 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.242687 744 leader_election.cc:288] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.243273 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.241597 722 ts_tablet_manager.cc:1398] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20240501 20:11:17.243971 648 leader_election.cc:341] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dadc37f905e3414782d795171cd11105 (127.0.100.1:40163): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.244735 746 raft_consensus.cc:504] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.244889 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.245733 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.246191 722 tablet_bootstrap.cc:492] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.246433 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.246877 746 leader_election.cc:288] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.247218 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.247915 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.248111 533 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.248205 722 tablet_bootstrap.cc:654] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.252369 533 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 1.
I20240501 20:11:17.252859 648 leader_election.cc:302] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.253363 746 raft_consensus.cc:2781] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.253546 746 raft_consensus.cc:686] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:17.253881 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.253849 746 consensus_queue.cc:237] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
W20240501 20:11:17.254470 646 leader_election.cc:341] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:11:17.254866 646 leader_election.cc:341] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:11:17.255407 646 leader_election.cc:341] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:11:17.255717 646 leader_election.cc:341] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.255941 646 leader_election.cc:302] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff6dcd0fb7934d0d9de184137f1c6d67; no voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105
I20240501 20:11:17.256404 722 tablet_bootstrap.cc:492] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.256562 722 ts_tablet_manager.cc:1367] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
W20240501 20:11:17.256594 646 leader_election.cc:341] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.257109 730 raft_consensus.cc:2726] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:11:17.257790 722 raft_consensus.cc:348] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.258011 722 raft_consensus.cc:374] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.258118 722 raft_consensus.cc:729] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.258493 722 consensus_queue.cc:260] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.259162 722 ts_tablet_manager.cc:1398] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:11:17.260023 727 tablet_bootstrap.cc:492] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.260191 727 ts_tablet_manager.cc:1367] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.081s user 0.013s sys 0.062s
I20240501 20:11:17.260218 724 ts_tablet_manager.cc:1398] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.075s user 0.006s sys 0.046s
I20240501 20:11:17.260389 722 tablet_bootstrap.cc:492] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.260550 724 tablet_bootstrap.cc:492] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.260953 727 raft_consensus.cc:348] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.261196 727 raft_consensus.cc:374] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.261286 727 raft_consensus.cc:729] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.261611 727 consensus_queue.cc:260] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.262291 724 tablet_bootstrap.cc:654] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.262481 722 tablet_bootstrap.cc:654] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.262995 727 ts_tablet_manager.cc:1398] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240501 20:11:17.263298 727 tablet_bootstrap.cc:492] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.264874 727 tablet_bootstrap.cc:654] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.267493 429 catalog_manager.cc:5484] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 1 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:17.286618 722 tablet_bootstrap.cc:492] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.286619 724 tablet_bootstrap.cc:492] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.286909 722 ts_tablet_manager.cc:1367] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.010s
I20240501 20:11:17.286907 724 ts_tablet_manager.cc:1367] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.010s
I20240501 20:11:17.287855 724 raft_consensus.cc:348] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.288096 724 raft_consensus.cc:374] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.287935 722 raft_consensus.cc:348] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.288206 724 raft_consensus.cc:729] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.288400 722 raft_consensus.cc:374] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.288528 722 raft_consensus.cc:729] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.288440 724 consensus_queue.cc:260] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.288851 722 consensus_queue.cc:260] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.289502 722 ts_tablet_manager.cc:1398] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:17.289798 722 tablet_bootstrap.cc:492] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105: Bootstrap starting.
I20240501 20:11:17.291698 724 ts_tablet_manager.cc:1398] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:11:17.292635 724 tablet_bootstrap.cc:492] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.293823 727 tablet_bootstrap.cc:492] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.293879 722 tablet_bootstrap.cc:654] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.293980 727 ts_tablet_manager.cc:1367] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.019s
I20240501 20:11:17.295635 727 raft_consensus.cc:348] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.295889 727 raft_consensus.cc:374] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.296061 724 tablet_bootstrap.cc:654] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.296036 727 raft_consensus.cc:729] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.296343 727 consensus_queue.cc:260] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.296932 727 ts_tablet_manager.cc:1398] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:11:17.297308 727 tablet_bootstrap.cc:492] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.299141 727 tablet_bootstrap.cc:654] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.306891 722 tablet_bootstrap.cc:492] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105: No bootstrap required, opened a new log
I20240501 20:11:17.307044 722 ts_tablet_manager.cc:1367] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.006s
I20240501 20:11:17.307641 727 tablet_bootstrap.cc:492] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.307845 727 ts_tablet_manager.cc:1367] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20240501 20:11:17.307890 722 raft_consensus.cc:348] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.308094 722 raft_consensus.cc:374] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.308140 724 tablet_bootstrap.cc:492] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.308195 722 raft_consensus.cc:729] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.308295 724 ts_tablet_manager.cc:1367] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.006s
I20240501 20:11:17.308447 722 consensus_queue.cc:260] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.308807 727 raft_consensus.cc:348] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.308998 722 ts_tablet_manager.cc:1398] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:11:17.308970 724 raft_consensus.cc:348] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.309118 727 raft_consensus.cc:374] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.309232 724 raft_consensus.cc:374] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.309240 727 raft_consensus.cc:729] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.309322 724 raft_consensus.cc:729] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.309680 724 consensus_queue.cc:260] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.309700 727 consensus_queue.cc:260] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.310222 724 ts_tablet_manager.cc:1398] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:17.310463 727 ts_tablet_manager.cc:1398] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:11:17.310518 724 tablet_bootstrap.cc:492] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.310842 727 tablet_bootstrap.cc:492] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.312734 727 tablet_bootstrap.cc:654] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.312734 724 tablet_bootstrap.cc:654] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.315591 731 raft_consensus.cc:482] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.315739 731 raft_consensus.cc:504] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.316614 731 leader_election.cc:288] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.332026 727 tablet_bootstrap.cc:492] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.332266 727 ts_tablet_manager.cc:1367] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.017s
I20240501 20:11:17.332535 724 tablet_bootstrap.cc:492] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.332691 724 ts_tablet_manager.cc:1367] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.016s
I20240501 20:11:17.333854 727 raft_consensus.cc:348] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.334192 724 raft_consensus.cc:348] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.334481 724 raft_consensus.cc:374] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.334610 724 raft_consensus.cc:729] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.334913 724 consensus_queue.cc:260] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.335130 727 raft_consensus.cc:374] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.335255 727 raft_consensus.cc:729] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.335502 724 ts_tablet_manager.cc:1398] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:11:17.335505 727 consensus_queue.cc:260] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.335846 724 tablet_bootstrap.cc:492] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.337213 727 ts_tablet_manager.cc:1398] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:11:17.337533 727 tablet_bootstrap.cc:492] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.340801 731 raft_consensus.cc:482] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.340983 731 raft_consensus.cc:504] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.342706 724 tablet_bootstrap.cc:654] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.342928 731 leader_election.cc:288] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905), dadc37f905e3414782d795171cd11105 (127.0.100.1:40163)
I20240501 20:11:17.344026 725 raft_consensus.cc:482] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.344183 725 raft_consensus.cc:504] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.345338 725 leader_election.cc:288] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.345970 727 tablet_bootstrap.cc:654] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.346148 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" is_pre_election: true
I20240501 20:11:17.346712 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10085ca24ddb4d5098b7abd0e5d5eb25" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.346565 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.346997 608 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 0.
I20240501 20:11:17.347628 533 raft_consensus.cc:2454] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 0.
I20240501 20:11:17.347600 497 leader_election.cc:302] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:17.347003 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.347846 682 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 0.
I20240501 20:11:17.347896 725 raft_consensus.cc:2781] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.348007 532 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 0.
I20240501 20:11:17.348305 725 raft_consensus.cc:482] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.348503 725 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.348510 574 leader_election.cc:302] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:17.348819 731 raft_consensus.cc:2781] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.348938 731 raft_consensus.cc:482] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.349036 731 raft_consensus.cc:3037] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.348830 574 leader_election.cc:302] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:17.350097 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10085ca24ddb4d5098b7abd0e5d5eb25" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" is_pre_election: true
W20240501 20:11:17.350633 572 leader_election.cc:341] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.352051 725 raft_consensus.cc:504] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.352285 731 raft_consensus.cc:504] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.352900 731 leader_election.cc:288] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.353071 731 raft_consensus.cc:2781] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.353013 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.353169 731 raft_consensus.cc:482] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.353204 682 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.353251 731 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.353381 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10085ca24ddb4d5098b7abd0e5d5eb25" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
W20240501 20:11:17.354068 572 leader_election.cc:341] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.354936 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" is_pre_election: true
I20240501 20:11:17.356115 682 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 1.
I20240501 20:11:17.356488 497 leader_election.cc:302] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.358013 725 leader_election.cc:288] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 election: Requested vote from peers ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.357625 731 raft_consensus.cc:504] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.361496 725 raft_consensus.cc:2781] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.361660 725 raft_consensus.cc:686] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:17.362056 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.364176 682 raft_consensus.cc:2379] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5610b9abb5254acbafe12918f369617e in current term 1: Already voted for candidate dadc37f905e3414782d795171cd11105 in this term.
I20240501 20:11:17.364847 731 leader_election.cc:288] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Requested vote from peers ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905), dadc37f905e3414782d795171cd11105 (127.0.100.1:40163)
I20240501 20:11:17.364655 725 consensus_queue.cc:237] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:17.402866 746 raft_consensus.cc:482] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.403110 746 raft_consensus.cc:504] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.404114 746 leader_election.cc:288] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.404477 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.404708 532 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 0.
I20240501 20:11:17.405259 648 leader_election.cc:302] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.405297 765 raft_consensus.cc:482] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.405473 765 raft_consensus.cc:504] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
W20240501 20:11:17.404009 574 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.100.1:40163, user_credentials={real_user=slave}} blocked reactor thread for 55178us
I20240501 20:11:17.406172 746 raft_consensus.cc:2781] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.406306 746 raft_consensus.cc:482] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.406395 746 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.406621 765 leader_election.cc:288] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.407617 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.407642 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.407824 608 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 0.
I20240501 20:11:17.408316 574 leader_election.cc:302] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5610b9abb5254acbafe12918f369617e; no voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:17.408208 429 catalog_manager.cc:5484] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 0 to 1, leader changed from <none> to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.406582 760 raft_consensus.cc:482] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.408568 731 raft_consensus.cc:2726] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240501 20:11:17.408607 760 raft_consensus.cc:504] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.409334 760 leader_election.cc:288] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.409711 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" is_pre_election: true
I20240501 20:11:17.410176 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
W20240501 20:11:17.410391 572 leader_election.cc:341] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.410199 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10085ca24ddb4d5098b7abd0e5d5eb25" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.410567 532 raft_consensus.cc:3037] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:11:17.411460 497 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.100.3:40905, user_credentials={real_user=slave}} blocked reactor thread for 55004.5us
I20240501 20:11:17.412091 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.412331 608 raft_consensus.cc:2379] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dadc37f905e3414782d795171cd11105 in current term 1: Already voted for candidate 5610b9abb5254acbafe12918f369617e in this term.
I20240501 20:11:17.412513 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" is_pre_election: true
I20240501 20:11:17.412684 682 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 0.
I20240501 20:11:17.412628 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.412878 607 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 0.
I20240501 20:11:17.413151 497 leader_election.cc:302] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.413218 532 raft_consensus.cc:2454] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 1.
I20240501 20:11:17.410387 533 raft_consensus.cc:2454] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 0.
I20240501 20:11:17.409309 746 raft_consensus.cc:504] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.413805 574 leader_election.cc:302] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters: ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:17.414084 746 leader_election.cc:288] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.414111 760 raft_consensus.cc:2781] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.414314 760 raft_consensus.cc:686] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 1 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:17.414399 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.414599 533 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.414573 760 consensus_queue.cc:237] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.415351 724 tablet_bootstrap.cc:492] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.415529 724 ts_tablet_manager.cc:1367] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.080s user 0.015s sys 0.031s
I20240501 20:11:17.416374 724 raft_consensus.cc:348] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.416613 724 raft_consensus.cc:374] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.416800 724 raft_consensus.cc:729] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.406179 725 raft_consensus.cc:482] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.417202 574 leader_election.cc:302] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters: ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:17.417153 724 consensus_queue.cc:260] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.413833 761 raft_consensus.cc:2781] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.417412 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.417301 727 tablet_bootstrap.cc:492] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.417383 725 raft_consensus.cc:504] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.418116 731 raft_consensus.cc:2781] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.418118 607 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.418789 725 leader_election.cc:288] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.419278 731 raft_consensus.cc:482] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.420009 724 ts_tablet_manager.cc:1398] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20240501 20:11:17.421679 731 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.421772 727 ts_tablet_manager.cc:1367] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.081s user 0.018s sys 0.028s
I20240501 20:11:17.422070 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" is_pre_election: true
I20240501 20:11:17.422260 682 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 0.
I20240501 20:11:17.419595 761 raft_consensus.cc:482] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.424054 724 tablet_bootstrap.cc:492] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67: Bootstrap starting.
I20240501 20:11:17.424407 533 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 1.
I20240501 20:11:17.424664 761 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.424014 497 leader_election.cc:302] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.425233 648 leader_election.cc:302] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.425673 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.426141 746 raft_consensus.cc:2781] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.426738 746 raft_consensus.cc:686] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:17.427333 608 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 0.
I20240501 20:11:17.427385 746 consensus_queue.cc:237] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.428270 725 raft_consensus.cc:2781] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.428841 607 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 1.
I20240501 20:11:17.430409 725 raft_consensus.cc:482] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.430819 725 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.434221 731 raft_consensus.cc:504] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.435564 731 leader_election.cc:288] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.434929 727 raft_consensus.cc:348] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.436415 727 raft_consensus.cc:374] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.436964 724 tablet_bootstrap.cc:654] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.437026 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
W20240501 20:11:17.437655 572 leader_election.cc:341] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:17.436885 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.438634 727 raft_consensus.cc:729] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.439713 725 raft_consensus.cc:504] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.440057 429 catalog_manager.cc:5484] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 1 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.440349 430 catalog_manager.cc:5484] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 1 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:17.441836 533 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.444638 533 raft_consensus.cc:2454] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 1.
I20240501 20:11:17.445187 574 leader_election.cc:302] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters: ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:17.445545 731 raft_consensus.cc:2781] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.445786 731 raft_consensus.cc:686] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:17.446381 731 consensus_queue.cc:237] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.449196 761 raft_consensus.cc:504] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.449858 761 leader_election.cc:288] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.450268 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.450474 607 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.450788 724 tablet_bootstrap.cc:492] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67: No bootstrap required, opened a new log
I20240501 20:11:17.450930 724 ts_tablet_manager.cc:1367] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent bootstrapping tablet: real 0.031s user 0.012s sys 0.001s
I20240501 20:11:17.451360 725 leader_election.cc:288] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.451764 724 raft_consensus.cc:348] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.451965 724 raft_consensus.cc:374] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.451911 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.452062 724 raft_consensus.cc:729] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.452119 682 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.452292 724 consensus_queue.cc:260] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.452839 724 ts_tablet_manager.cc:1398] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:11:17.453074 429 catalog_manager.cc:5484] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 1 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.445578 727 consensus_queue.cc:260] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.454098 727 ts_tablet_manager.cc:1398] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20240501 20:11:17.454314 727 tablet_bootstrap.cc:492] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e: Bootstrap starting.
I20240501 20:11:17.454600 607 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 1.
I20240501 20:11:17.454845 682 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 1.
I20240501 20:11:17.455665 727 tablet_bootstrap.cc:654] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:17.456226 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.456382 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.456508 607 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.456650 682 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.459084 727 tablet_bootstrap.cc:492] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e: No bootstrap required, opened a new log
I20240501 20:11:17.459270 727 ts_tablet_manager.cc:1367] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 20:11:17.459887 607 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 1.
I20240501 20:11:17.460076 727 raft_consensus.cc:348] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.460275 727 raft_consensus.cc:374] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:17.460400 727 raft_consensus.cc:729] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Initialized, Role: FOLLOWER
I20240501 20:11:17.460664 727 consensus_queue.cc:260] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.461212 497 leader_election.cc:302] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.461539 725 raft_consensus.cc:2781] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.461750 725 raft_consensus.cc:686] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:17.461781 497 leader_election.cc:302] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:17.462031 725 consensus_queue.cc:237] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.462235 766 raft_consensus.cc:2781] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.462366 766 raft_consensus.cc:686] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:17.461253 727 ts_tablet_manager.cc:1398] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:11:17.462671 766 consensus_queue.cc:237] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.464119 682 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 1.
I20240501 20:11:17.466681 430 catalog_manager.cc:5484] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 0 to 1, leader changed from <none> to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.470489 430 catalog_manager.cc:5484] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 0 to 1, leader changed from <none> to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.544021 746 raft_consensus.cc:482] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.544231 746 raft_consensus.cc:504] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.544840 746 leader_election.cc:288] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.545356 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd7882a099d4410bb0664b9ff201a257" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.545364 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd7882a099d4410bb0664b9ff201a257" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.545598 607 raft_consensus.cc:2454] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 0.
I20240501 20:11:17.545601 533 raft_consensus.cc:2454] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 0.
I20240501 20:11:17.546133 648 leader_election.cc:302] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.546413 746 raft_consensus.cc:2781] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:17.546519 746 raft_consensus.cc:482] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:17.546629 746 raft_consensus.cc:3037] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:11:17.549237 479 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 20:11:17.549368 746 raft_consensus.cc:504] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.549856 746 leader_election.cc:288] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.550200 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd7882a099d4410bb0664b9ff201a257" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.550217 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd7882a099d4410bb0664b9ff201a257" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.550375 533 raft_consensus.cc:3037] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.550382 607 raft_consensus.cc:3037] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.552740 607 raft_consensus.cc:2454] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 1.
I20240501 20:11:17.552762 533 raft_consensus.cc:2454] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 1.
I20240501 20:11:17.553144 648 leader_election.cc:302] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.553417 746 raft_consensus.cc:2781] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:17.553568 746 raft_consensus.cc:686] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:17.553817 746 consensus_queue.cc:237] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.556191 430 catalog_manager.cc:5484] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 1 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:17.611936 746 consensus_queue.cc:1035] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.615993 607 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.619467 743 consensus_queue.cc:1035] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.631048 682 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
mode: GRACEFUL
new_leader_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:48978
I20240501 20:11:17.631320 682 raft_consensus.cc:595] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Received request to transfer leadership to TS dadc37f905e3414782d795171cd11105
I20240501 20:11:17.633476 607 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.633520 682 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
mode: GRACEFUL
new_leader_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:48978
I20240501 20:11:17.633720 682 raft_consensus.cc:595] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Received request to transfer leadership to TS dadc37f905e3414782d795171cd11105
I20240501 20:11:17.636549 746 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.639976 730 raft_consensus.cc:482] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.640352 730 raft_consensus.cc:504] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.641022 730 leader_election.cc:288] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.641330 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.641618 532 raft_consensus.cc:2379] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff6dcd0fb7934d0d9de184137f1c6d67 in current term 1: Already voted for candidate 5610b9abb5254acbafe12918f369617e in this term.
I20240501 20:11:17.641583 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.642199 648 leader_election.cc:302] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff6dcd0fb7934d0d9de184137f1c6d67; no voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105
I20240501 20:11:17.642596 743 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.644472 746 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.644747 607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
mode: GRACEFUL
new_leader_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:52062
I20240501 20:11:17.644922 607 raft_consensus.cc:595] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 LEADER]: Received request to transfer leadership to TS dadc37f905e3414782d795171cd11105
I20240501 20:11:17.646322 743 raft_consensus.cc:2726] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:11:17.648435 746 raft_consensus.cc:979] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67: : Instructing follower dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:17.648598 746 raft_consensus.cc:1067] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Signalling peer dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:17.649422 533 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb"
dest_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:44554
I20240501 20:11:17.649605 533 raft_consensus.cc:482] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:17.649714 533 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.651674 533 raft_consensus.cc:504] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.652235 533 leader_election.cc:288] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 2 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.652783 682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.652995 682 raft_consensus.cc:3032] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:17.653110 682 raft_consensus.cc:729] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:17.653398 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.653653 607 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.653528 682 consensus_queue.cc:260] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.654002 533 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac"
dest_uuid: "dadc37f905e3414782d795171cd11105"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:44568
I20240501 20:11:17.654080 682 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.654260 533 raft_consensus.cc:595] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:17.656428 682 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 2.
I20240501 20:11:17.656440 607 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 2.
I20240501 20:11:17.656744 682 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:48978
I20240501 20:11:17.656877 497 leader_election.cc:302] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.656894 682 raft_consensus.cc:595] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:17.657187 725 raft_consensus.cc:2781] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:17.657342 725 raft_consensus.cc:686] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:17.657610 725 consensus_queue.cc:237] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.659816 428 catalog_manager.cc:5484] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 1 to 2, leader changed from ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3) to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 2 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.660157 533 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9"
dest_uuid: "dadc37f905e3414782d795171cd11105"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:44568
I20240501 20:11:17.660342 533 raft_consensus.cc:595] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:17.867733 731 consensus_queue.cc:1035] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.870153 760 raft_consensus.cc:979] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e: : Instructing follower dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:17.870385 731 raft_consensus.cc:1067] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 LEADER]: Signalling peer dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:17.871006 532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d"
dest_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:44562
I20240501 20:11:17.871435 532 raft_consensus.cc:482] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:17.871567 532 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.872329 731 consensus_queue.cc:1035] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.874369 532 raft_consensus.cc:504] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.875401 532 leader_election.cc:288] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 2 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.875802 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.875998 681 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.876255 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:17.876438 607 raft_consensus.cc:3032] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:17.876515 607 raft_consensus.cc:729] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:17.876730 607 consensus_queue.cc:260] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.876979 607 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.878093 681 raft_consensus.cc:2454] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 2.
I20240501 20:11:17.878438 497 leader_election.cc:302] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.878728 725 raft_consensus.cc:2781] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:17.878907 725 raft_consensus.cc:686] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:17.878962 607 raft_consensus.cc:2454] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 2.
I20240501 20:11:17.879151 725 consensus_queue.cc:237] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.880833 430 catalog_manager.cc:5484] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 1 to 2, leader changed from 5610b9abb5254acbafe12918f369617e (127.0.100.2) to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 2 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.895275 725 consensus_queue.cc:1035] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.899190 765 consensus_queue.cc:1035] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.901571 725 raft_consensus.cc:979] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:17.901700 725 raft_consensus.cc:1067] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:17.902232 607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52048
I20240501 20:11:17.902393 607 raft_consensus.cc:482] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:17.902505 607 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.903131 746 raft_consensus.cc:482] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:17.903311 746 raft_consensus.cc:504] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.903661 681 raft_consensus.cc:3037] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:17.904032 746 leader_election.cc:288] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:17.904489 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10085ca24ddb4d5098b7abd0e5d5eb25" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dadc37f905e3414782d795171cd11105" is_pre_election: true
I20240501 20:11:17.904742 532 raft_consensus.cc:2379] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff6dcd0fb7934d0d9de184137f1c6d67 in current term 1: Already voted for candidate 5610b9abb5254acbafe12918f369617e in this term.
I20240501 20:11:17.904762 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10085ca24ddb4d5098b7abd0e5d5eb25" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5610b9abb5254acbafe12918f369617e" is_pre_election: true
I20240501 20:11:17.905252 646 leader_election.cc:302] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff6dcd0fb7934d0d9de184137f1c6d67; no voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105
I20240501 20:11:17.905638 607 raft_consensus.cc:504] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.906493 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.906678 532 raft_consensus.cc:3032] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:17.906752 532 raft_consensus.cc:729] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:17.906927 532 consensus_queue.cc:260] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.907159 532 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.907867 725 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.907970 746 raft_consensus.cc:2726] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:11:17.908874 731 consensus_queue.cc:1035] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.909586 532 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 2.
I20240501 20:11:17.910388 574 leader_election.cc:302] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:17.910744 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.910910 680 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.911826 784 raft_consensus.cc:2781] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:17.911981 784 raft_consensus.cc:686] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:17.912302 784 consensus_queue.cc:237] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.913398 680 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 2.
I20240501 20:11:17.915392 784 consensus_queue.cc:1035] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.915880 765 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.915571 428 catalog_manager.cc:5484] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 1 to 2, leader changed from dadc37f905e3414782d795171cd11105 (127.0.100.1) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 2 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.914111 607 leader_election.cc:288] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 2 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.922854 766 raft_consensus.cc:979] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:17.923010 766 raft_consensus.cc:1067] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:17.923563 608 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52048
I20240501 20:11:17.923787 608 raft_consensus.cc:482] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:17.924259 608 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.926182 608 raft_consensus.cc:504] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.926678 608 leader_election.cc:288] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 2 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:17.926973 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:17.927084 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:17.927146 532 raft_consensus.cc:3032] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:17.927276 680 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.927759 532 raft_consensus.cc:729] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:17.927982 532 consensus_queue.cc:260] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.928241 532 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:17.929862 680 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 2.
I20240501 20:11:17.930183 572 leader_election.cc:302] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:17.930248 532 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 2.
I20240501 20:11:17.930416 760 raft_consensus.cc:2781] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:17.930548 760 raft_consensus.cc:686] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:17.930769 760 consensus_queue.cc:237] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:17.932436 429 catalog_manager.cc:5484] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 1 to 2, leader changed from dadc37f905e3414782d795171cd11105 (127.0.100.1) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 2 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:17.956732 765 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.960656 725 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.978507 746 consensus_queue.cc:1035] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:17.982268 730 consensus_queue.cc:1035] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:18.037575 730 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:18.040109 744 raft_consensus.cc:979] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67: : Instructing follower dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:18.040292 743 raft_consensus.cc:1067] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Signalling peer dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:18.041157 533 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975"
dest_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:44554
I20240501 20:11:18.041371 533 raft_consensus.cc:482] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:18.041496 533 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:18.042315 746 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:18.044656 533 raft_consensus.cc:504] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:18.045665 680 raft_consensus.cc:1261] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.046146 725 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.046371 533 leader_election.cc:288] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 2 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:18.046826 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:18.047044 608 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:18.047302 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:18.047487 680 raft_consensus.cc:3032] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:18.047606 680 raft_consensus.cc:729] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:18.047870 680 consensus_queue.cc:260] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:18.048177 680 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:18.050055 608 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 2.
I20240501 20:11:18.050406 680 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 2.
I20240501 20:11:18.050403 497 leader_election.cc:302] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:18.050705 725 raft_consensus.cc:2781] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:18.050840 725 raft_consensus.cc:686] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:18.051134 725 consensus_queue.cc:237] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:18.051874 608 raft_consensus.cc:1261] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.052498 725 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.053422 430 catalog_manager.cc:5484] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 1 to 2, leader changed from ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3) to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 2 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:18.153409 744 raft_consensus.cc:979] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:18.153636 744 raft_consensus.cc:1067] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:18.154217 608 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52056
I20240501 20:11:18.154431 608 raft_consensus.cc:482] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:18.154538 608 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:18.156343 608 raft_consensus.cc:504] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:18.156899 608 leader_election.cc:288] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 2 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:18.157298 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:18.157354 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:18.157537 533 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:18.157541 680 raft_consensus.cc:3032] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:18.157696 680 raft_consensus.cc:729] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:18.157941 680 consensus_queue.cc:260] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:18.158337 680 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:18.160385 533 raft_consensus.cc:2454] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 2.
I20240501 20:11:18.160756 574 leader_election.cc:302] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:18.160934 680 raft_consensus.cc:2454] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 2.
I20240501 20:11:18.161058 784 raft_consensus.cc:2781] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:18.161223 784 raft_consensus.cc:686] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:18.161912 784 consensus_queue.cc:237] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:18.163765 429 catalog_manager.cc:5484] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 1 to 2, leader changed from ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 2 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:18.367611 608 raft_consensus.cc:1261] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.368115 725 consensus_queue.cc:1035] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.371189 680 raft_consensus.cc:1261] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.371628 725 consensus_queue.cc:1035] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.391630 533 raft_consensus.cc:1261] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.392097 760 consensus_queue.cc:1035] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.395103 680 raft_consensus.cc:1261] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.395558 760 consensus_queue.cc:1035] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.426815 533 raft_consensus.cc:1261] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.427392 760 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.429865 608 raft_consensus.cc:1261] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.430712 765 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.431169 680 raft_consensus.cc:1261] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.431648 790 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.435670 680 raft_consensus.cc:1261] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.436262 766 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.560973 533 raft_consensus.cc:1261] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.561430 784 consensus_queue.cc:1035] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:18.564024 680 raft_consensus.cc:1261] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:18.564733 760 consensus_queue.cc:1035] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:20.670971 400 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240501 20:11:20.671396 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:20.679176 533 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab"
dest_uuid: "dadc37f905e3414782d795171cd11105"
mode: GRACEFUL
new_leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:44574
I20240501 20:11:20.679361 533 raft_consensus.cc:595] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Received request to transfer leadership to TS ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:20.685163 608 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
mode: GRACEFUL
new_leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:52068
I20240501 20:11:20.685349 608 raft_consensus.cc:595] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Received request to transfer leadership to TS ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:20.685799 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 20:11:20.686044 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:20.917068 799 raft_consensus.cc:979] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: : Instructing follower ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:20.917245 799 raft_consensus.cc:1067] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Signalling peer ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:20.917850 681 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:48956
I20240501 20:11:20.918036 681 raft_consensus.cc:482] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:20.918160 681 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:20.976948 681 raft_consensus.cc:504] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:20.977622 681 leader_election.cc:288] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 2 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:20.978229 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:20.978178 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:20.978410 608 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:20.978418 533 raft_consensus.cc:3032] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:20.978528 533 raft_consensus.cc:729] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:20.978823 533 consensus_queue.cc:260] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:20.979236 533 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:20.990489 784 raft_consensus.cc:979] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e: : Instructing follower ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:20.990643 784 raft_consensus.cc:1067] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Signalling peer ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:20.991176 681 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:48968
I20240501 20:11:20.991346 681 raft_consensus.cc:482] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:20.991464 681 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:21.078991 608 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 2.
I20240501 20:11:21.078965 533 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 2.
I20240501 20:11:21.078954 681 raft_consensus.cc:504] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:21.079488 646 leader_election.cc:302] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:21.079828 801 raft_consensus.cc:2781] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:21.080866 801 raft_consensus.cc:686] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:21.081156 533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:21.081267 801 consensus_queue.cc:237] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:21.081156 608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:21.081521 533 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:21.081620 608 raft_consensus.cc:3032] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:21.081701 608 raft_consensus.cc:729] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:21.082062 608 consensus_queue.cc:260] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:21.082391 608 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:21.081189 681 leader_election.cc:288] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 3 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:21.084584 533 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 3.
I20240501 20:11:21.084684 429 catalog_manager.cc:5484] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 1 to 2, leader changed from dadc37f905e3414782d795171cd11105 (127.0.100.1) to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 2 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:21.085084 648 leader_election.cc:302] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:21.085357 801 raft_consensus.cc:2781] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:21.085553 801 raft_consensus.cc:686] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:21.085831 801 consensus_queue.cc:237] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:21.090325 429 catalog_manager.cc:5484] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 2 to 3, leader changed from 5610b9abb5254acbafe12918f369617e (127.0.100.2) to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 3 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:21.179356 608 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 3.
I20240501 20:11:21.546694 608 raft_consensus.cc:1261] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:21.547343 801 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:21.551548 533 raft_consensus.cc:1261] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:21.552142 533 raft_consensus.cc:1261] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:21.552728 801 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:21.552798 807 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:21.564404 608 raft_consensus.cc:1261] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:21.564965 807 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:21.693698 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:21.695227 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:21.695401 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:22.695762 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:22.697407 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:22.697587 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:23.697984 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:23.699754 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:23.699959 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:24.700332 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:24.702020 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:24.702188 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:25.702628 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:25.704299 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:25.704489 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:26.704849 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:26.706450 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:26.706624 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:27.707003 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:27.708540 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:27.708734 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:28.709089 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:28.710640 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:28.710809 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:29.711176 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:29.712728 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:29.712916 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:30.721906 400 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240501 20:11:30.723489 681 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:48978
I20240501 20:11:30.723716 681 raft_consensus.cc:595] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:30.725508 532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975"
dest_uuid: "dadc37f905e3414782d795171cd11105"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:44568
I20240501 20:11:30.725672 532 raft_consensus.cc:595] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:30.727419 532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb"
dest_uuid: "dadc37f905e3414782d795171cd11105"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:44568
I20240501 20:11:30.727571 532 raft_consensus.cc:595] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:30.729265 532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d"
dest_uuid: "dadc37f905e3414782d795171cd11105"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:44568
I20240501 20:11:30.729427 532 raft_consensus.cc:595] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:30.731001 681 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
mode: GRACEFUL
new_leader_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:48978
I20240501 20:11:30.731163 681 raft_consensus.cc:595] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 LEADER]: Received request to transfer leadership to TS 5610b9abb5254acbafe12918f369617e
I20240501 20:11:30.923640 825 raft_consensus.cc:979] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.923794 825 raft_consensus.cc:1067] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.924484 608 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52048
I20240501 20:11:30.924707 608 raft_consensus.cc:482] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:30.924809 608 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:30.926713 608 raft_consensus.cc:504] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:30.927356 608 leader_election.cc:288] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:30.927762 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:30.927855 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:30.927948 532 raft_consensus.cc:3032] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:30.928059 532 raft_consensus.cc:729] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:30.928088 681 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:30.928287 532 consensus_queue.cc:260] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:30.928580 532 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:30.930115 681 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:30.930495 572 leader_election.cc:302] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:30.930532 532 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:30.930800 822 raft_consensus.cc:2781] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:30.931221 822 raft_consensus.cc:686] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:30.931572 822 consensus_queue.cc:237] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:30.934087 430 catalog_manager.cc:5484] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 2 to 3, leader changed from dadc37f905e3414782d795171cd11105 (127.0.100.1) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 3 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:30.978106 825 raft_consensus.cc:979] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.978268 825 raft_consensus.cc:1067] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.978811 608 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52048
I20240501 20:11:30.978993 608 raft_consensus.cc:482] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:30.979105 608 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:30.980895 608 raft_consensus.cc:504] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:30.981464 608 leader_election.cc:288] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:30.981796 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:30.981855 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35802f0e6f7b46c89d30a69a86b72d7d" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:30.981961 532 raft_consensus.cc:3032] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:30.982049 532 raft_consensus.cc:729] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:30.982066 681 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:30.982286 532 consensus_queue.cc:260] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:30.982575 532 raft_consensus.cc:3037] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:30.984124 681 raft_consensus.cc:2454] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:30.984380 532 raft_consensus.cc:2454] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:30.984503 572 leader_election.cc:302] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:30.984768 822 raft_consensus.cc:2781] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:30.984930 822 raft_consensus.cc:686] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:30.985199 822 consensus_queue.cc:237] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:30.987594 430 catalog_manager.cc:5484] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 2 to 3, leader changed from dadc37f905e3414782d795171cd11105 (127.0.100.1) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 3 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:30.995054 823 raft_consensus.cc:979] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.995177 823 raft_consensus.cc:1067] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.995752 608 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52056
I20240501 20:11:30.995967 608 raft_consensus.cc:482] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:30.996088 608 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:30.996675 823 raft_consensus.cc:979] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.996827 823 raft_consensus.cc:1067] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:30.997431 607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52056
I20240501 20:11:30.997606 607 raft_consensus.cc:482] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:30.997722 607 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:30.998510 608 raft_consensus.cc:504] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:30.999047 608 leader_election.cc:288] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 4 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:30.999382 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:30.999480 681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5366ac20e74b4e9a886754037bf78bac" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:30.999563 532 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:30.999660 681 raft_consensus.cc:3032] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 20:11:30.999737 681 raft_consensus.cc:729] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:30.999851 607 raft_consensus.cc:504] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:30.999979 681 consensus_queue.cc:260] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:31.000288 681 raft_consensus.cc:3037] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:31.000555 607 leader_election.cc:288] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Requested vote from peers ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905), dadc37f905e3414782d795171cd11105 (127.0.100.1:40163)
I20240501 20:11:31.000875 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:31.001092 680 raft_consensus.cc:3032] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:31.001179 680 raft_consensus.cc:729] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:31.001456 680 consensus_queue.cc:260] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:31.001809 680 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:31.002365 532 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 4.
I20240501 20:11:31.002517 681 raft_consensus.cc:2454] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 4.
I20240501 20:11:31.002781 574 leader_election.cc:302] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, dadc37f905e3414782d795171cd11105; no voters:
I20240501 20:11:31.002992 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:31.003224 532 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:31.003332 822 raft_consensus.cc:2781] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Leader election won for term 4
I20240501 20:11:31.003471 822 raft_consensus.cc:686] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 4 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:31.003770 822 consensus_queue.cc:237] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:31.004215 680 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:31.005082 572 leader_election.cc:302] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:31.005350 827 raft_consensus.cc:2781] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:31.005510 827 raft_consensus.cc:686] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:31.005738 532 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:31.005740 827 consensus_queue.cc:237] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:31.008335 430 catalog_manager.cc:5484] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 3 to 4, leader changed from ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 4 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:31.012151 430 catalog_manager.cc:5484] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 2 to 3, leader changed from ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 3 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:31.263518 799 raft_consensus.cc:979] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105: : Instructing follower 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:31.263695 799 raft_consensus.cc:1067] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Signalling peer 5610b9abb5254acbafe12918f369617e to start an election
I20240501 20:11:31.264247 607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
from {username='slave'} at 127.0.0.1:52048
I20240501 20:11:31.264448 607 raft_consensus.cc:482] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:31.264544 607 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:31.266688 607 raft_consensus.cc:504] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:31.267454 607 leader_election.cc:288] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:31.267854 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:31.267982 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "5610b9abb5254acbafe12918f369617e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:31.268054 532 raft_consensus.cc:3032] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:31.268282 532 raft_consensus.cc:729] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:31.268324 680 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:31.268755 532 consensus_queue.cc:260] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:31.269189 532 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:31.271281 680 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:31.271786 572 leader_election.cc:302] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5610b9abb5254acbafe12918f369617e, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:31.271878 532 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5610b9abb5254acbafe12918f369617e in term 3.
I20240501 20:11:31.272104 827 raft_consensus.cc:2781] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:31.272269 827 raft_consensus.cc:686] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Becoming Leader. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:31.272569 827 consensus_queue.cc:237] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:31.275357 430 catalog_manager.cc:5484] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e reported cstate change: term changed from 2 to 3, leader changed from dadc37f905e3414782d795171cd11105 (127.0.100.1) to 5610b9abb5254acbafe12918f369617e (127.0.100.2). New cstate: current_term: 3 leader_uuid: "5610b9abb5254acbafe12918f369617e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:31.366668 680 raft_consensus.cc:1261] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.367161 827 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:31.371654 532 raft_consensus.cc:1261] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.372210 822 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:31.393301 532 raft_consensus.cc:1261] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.393795 826 consensus_queue.cc:1035] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:31.396860 680 raft_consensus.cc:1261] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.397696 827 consensus_queue.cc:1035] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:31.423444 532 raft_consensus.cc:1261] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:31.424011 827 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:31.427223 680 raft_consensus.cc:1261] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:31.427700 822 consensus_queue.cc:1035] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:31.428400 532 raft_consensus.cc:1261] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.429152 822 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:31.432981 680 raft_consensus.cc:1261] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.433524 822 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:31.743530 532 raft_consensus.cc:1261] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.744078 826 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:31.747349 680 raft_consensus.cc:1261] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Refusing update from remote peer 5610b9abb5254acbafe12918f369617e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:31.747895 827 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:33.744405 400 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240501 20:11:33.744635 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:33.747148 607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
mode: GRACEFUL
new_leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:52068
I20240501 20:11:33.747342 607 raft_consensus.cc:595] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Received request to transfer leadership to TS ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:33.748230 607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
mode: GRACEFUL
new_leader_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:52068
I20240501 20:11:33.748382 607 raft_consensus.cc:595] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Received request to transfer leadership to TS dadc37f905e3414782d795171cd11105
I20240501 20:11:33.749147 607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
mode: GRACEFUL
new_leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:52068
I20240501 20:11:33.749280 607 raft_consensus.cc:595] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Received request to transfer leadership to TS ff6dcd0fb7934d0d9de184137f1c6d67
I20240501 20:11:33.750022 607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
mode: GRACEFUL
new_leader_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:52068
I20240501 20:11:33.750154 607 raft_consensus.cc:595] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Received request to transfer leadership to TS dadc37f905e3414782d795171cd11105
I20240501 20:11:33.750945 607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9"
dest_uuid: "5610b9abb5254acbafe12918f369617e"
mode: GRACEFUL
new_leader_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:52068
I20240501 20:11:33.751073 607 raft_consensus.cc:595] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Received request to transfer leadership to TS dadc37f905e3414782d795171cd11105
I20240501 20:11:33.751389 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240501 20:11:33.751606 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:33.753095 851 raft_consensus.cc:979] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e: : Instructing follower dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:33.753227 851 raft_consensus.cc:1067] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Signalling peer dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:33.753759 532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9"
dest_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:44562
I20240501 20:11:33.753924 532 raft_consensus.cc:482] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:33.754025 532 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:33.756033 532 raft_consensus.cc:504] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.756687 532 leader_election.cc:288] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 3 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:33.757073 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:33.757136 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebf179fe3f24593b357e64b8bcf66c9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:33.757279 680 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:33.757272 607 raft_consensus.cc:3032] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:33.757450 607 raft_consensus.cc:729] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:33.757769 607 consensus_queue.cc:260] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.758153 607 raft_consensus.cc:3037] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:33.760058 680 raft_consensus.cc:2454] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 3.
I20240501 20:11:33.760422 497 leader_election.cc:302] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:33.760583 607 raft_consensus.cc:2454] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 3.
I20240501 20:11:33.760982 852 raft_consensus.cc:2781] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:33.761329 852 raft_consensus.cc:686] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 3 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:33.761577 852 consensus_queue.cc:237] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.763660 429 catalog_manager.cc:5484] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 2 to 3, leader changed from 5610b9abb5254acbafe12918f369617e (127.0.100.2) to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 3 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:33.871104 826 raft_consensus.cc:979] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e: : Instructing follower dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:33.871281 826 raft_consensus.cc:1067] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Signalling peer dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:33.871846 532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9"
dest_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:44562
I20240501 20:11:33.872026 532 raft_consensus.cc:482] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:33.872120 532 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:33.873941 532 raft_consensus.cc:504] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.874430 532 leader_election.cc:288] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 3 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:33.874858 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:33.874914 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accccf29b0f42f29ccf26445c9c24a9" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:33.875032 607 raft_consensus.cc:3032] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:33.875120 680 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:33.875141 607 raft_consensus.cc:729] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:33.875361 607 consensus_queue.cc:260] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.875674 607 raft_consensus.cc:3037] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:33.877104 680 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 3.
I20240501 20:11:33.877449 497 leader_election.cc:302] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:33.877532 607 raft_consensus.cc:2454] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 3.
I20240501 20:11:33.877737 852 raft_consensus.cc:2781] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:33.877904 852 raft_consensus.cc:686] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 3 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:33.878120 852 consensus_queue.cc:237] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.880400 429 catalog_manager.cc:5484] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 2 to 3, leader changed from 5610b9abb5254acbafe12918f369617e (127.0.100.2) to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 3 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:33.935287 851 raft_consensus.cc:979] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e: : Instructing follower dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:33.935446 851 raft_consensus.cc:1067] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Signalling peer dadc37f905e3414782d795171cd11105 to start an election
I20240501 20:11:33.935997 532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb"
dest_uuid: "dadc37f905e3414782d795171cd11105"
from {username='slave'} at 127.0.0.1:44562
I20240501 20:11:33.936188 532 raft_consensus.cc:482] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:33.936270 532 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:33.938117 532 raft_consensus.cc:504] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.938625 532 leader_election.cc:288] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 4 election: Requested vote from peers 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017), ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3:40905)
I20240501 20:11:33.939039 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:33.939097 680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2bd5e66b57b44dab99e935910c30ebb" candidate_uuid: "dadc37f905e3414782d795171cd11105" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
I20240501 20:11:33.939260 607 raft_consensus.cc:3032] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Stepping down as leader of term 3
I20240501 20:11:33.939322 680 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:33.939357 607 raft_consensus.cc:729] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:33.939549 607 consensus_queue.cc:260] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.939858 607 raft_consensus.cc:3037] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:33.941407 680 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 4.
I20240501 20:11:33.941712 607 raft_consensus.cc:2454] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dadc37f905e3414782d795171cd11105 in term 4.
I20240501 20:11:33.941799 497 leader_election.cc:302] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:33.942106 852 raft_consensus.cc:2781] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 20:11:33.942220 852 raft_consensus.cc:686] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 4 LEADER]: Becoming Leader. State: Replica: dadc37f905e3414782d795171cd11105, State: Running, Role: LEADER
I20240501 20:11:33.942466 852 consensus_queue.cc:237] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:33.945290 429 catalog_manager.cc:5484] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 reported cstate change: term changed from 3 to 4, leader changed from 5610b9abb5254acbafe12918f369617e (127.0.100.2) to dadc37f905e3414782d795171cd11105 (127.0.100.1). New cstate: current_term: 4 leader_uuid: "dadc37f905e3414782d795171cd11105" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:34.003674 826 raft_consensus.cc:979] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e: : Instructing follower ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:34.003863 826 raft_consensus.cc:1067] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Signalling peer ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:34.004410 680 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:48968
I20240501 20:11:34.004576 680 raft_consensus.cc:482] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:34.004676 680 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:34.006587 680 raft_consensus.cc:504] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:34.007274 680 leader_election.cc:288] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 4 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:34.007710 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:34.007733 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780cb8fe58324c80a31ca93e2dc76975" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:34.007902 532 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:34.007941 607 raft_consensus.cc:3032] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Stepping down as leader of term 3
I20240501 20:11:34.008051 607 raft_consensus.cc:729] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:34.008282 607 consensus_queue.cc:260] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:34.008577 607 raft_consensus.cc:3037] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:34.010003 532 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 4.
I20240501 20:11:34.010423 648 leader_election.cc:302] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:34.010491 607 raft_consensus.cc:2454] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 4.
I20240501 20:11:34.010732 823 raft_consensus.cc:2781] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 20:11:34.011116 823 raft_consensus.cc:686] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:34.011420 823 consensus_queue.cc:237] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } }
I20240501 20:11:34.013865 429 catalog_manager.cc:5484] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 3 to 4, leader changed from 5610b9abb5254acbafe12918f369617e (127.0.100.2) to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 4 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:34.089002 851 raft_consensus.cc:979] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e: : Instructing follower ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:34.089197 851 raft_consensus.cc:1067] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Signalling peer ff6dcd0fb7934d0d9de184137f1c6d67 to start an election
I20240501 20:11:34.089745 680 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab"
dest_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67"
from {username='slave'} at 127.0.0.1:48968
I20240501 20:11:34.089947 680 raft_consensus.cc:482] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:34.090054 680 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:34.091856 680 raft_consensus.cc:504] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:34.092372 680 leader_election.cc:288] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 4 election: Requested vote from peers dadc37f905e3414782d795171cd11105 (127.0.100.1:40163), 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017)
I20240501 20:11:34.092788 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dadc37f905e3414782d795171cd11105"
I20240501 20:11:34.092815 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e9dabeca4843cf9c62c5b85c676eab" candidate_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5610b9abb5254acbafe12918f369617e"
I20240501 20:11:34.093004 607 raft_consensus.cc:3032] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Stepping down as leader of term 3
I20240501 20:11:34.093012 532 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:34.093147 607 raft_consensus.cc:729] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5610b9abb5254acbafe12918f369617e, State: Running, Role: LEADER
I20240501 20:11:34.093864 607 consensus_queue.cc:260] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:34.094177 607 raft_consensus.cc:3037] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:34.095508 532 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 4.
I20240501 20:11:34.095875 648 leader_election.cc:302] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dadc37f905e3414782d795171cd11105, ff6dcd0fb7934d0d9de184137f1c6d67; no voters:
I20240501 20:11:34.096066 607 raft_consensus.cc:2454] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6dcd0fb7934d0d9de184137f1c6d67 in term 4.
I20240501 20:11:34.096130 823 raft_consensus.cc:2781] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 20:11:34.096266 823 raft_consensus.cc:686] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 LEADER]: Becoming Leader. State: Replica: ff6dcd0fb7934d0d9de184137f1c6d67, State: Running, Role: LEADER
I20240501 20:11:34.096535 823 consensus_queue.cc:237] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } }
I20240501 20:11:34.098867 429 catalog_manager.cc:5484] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 reported cstate change: term changed from 3 to 4, leader changed from 5610b9abb5254acbafe12918f369617e (127.0.100.2) to ff6dcd0fb7934d0d9de184137f1c6d67 (127.0.100.3). New cstate: current_term: 4 leader_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:34.326166 680 raft_consensus.cc:1261] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:34.326726 852 consensus_queue.cc:1035] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:34.331086 607 raft_consensus.cc:1261] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:34.331579 853 consensus_queue.cc:1035] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:34.333896 608 raft_consensus.cc:1261] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:34.334362 853 consensus_queue.cc:1035] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:34.337563 680 raft_consensus.cc:1261] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:34.338685 870 consensus_queue.cc:1035] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:34.451778 532 raft_consensus.cc:1261] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:34.452369 823 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:34.456347 608 raft_consensus.cc:1261] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:34.456804 861 consensus_queue.cc:1035] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:34.485724 608 raft_consensus.cc:1261] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:34.486227 870 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:34.489763 680 raft_consensus.cc:1261] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Refusing update from remote peer dadc37f905e3414782d795171cd11105: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:34.490254 853 consensus_queue.cc:1035] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6dcd0fb7934d0d9de184137f1c6d67" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:34.561527 608 raft_consensus.cc:1261] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:34.562012 861 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5610b9abb5254acbafe12918f369617e" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:34.565294 532 raft_consensus.cc:1261] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Refusing update from remote peer ff6dcd0fb7934d0d9de184137f1c6d67: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:34.565834 823 consensus_queue.cc:1035] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dadc37f905e3414782d795171cd11105" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 40163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:34.752025 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:34.753634 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:34.753827 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:35.754226 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:35.755750 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:35.755940 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:36.756323 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:36.757997 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:36.758205 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:37.758518 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:37.760092 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:37.760272 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:38.760615 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:38.762151 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:38.762341 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:39.762720 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:39.764276 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:39.764457 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:40.764892 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:40.766705 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:40.766893 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:41.767731 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:41.769346 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:41.769510 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:42.769877 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:42.771416 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:42.771602 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:43.780794 400 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240501 20:11:43.781077 400 tablet_server.cc:178] TabletServer@127.0.100.1:0 shutting down...
I20240501 20:11:43.791519 400 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 20:11:43.791806 400 tablet_replica.cc:330] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.792162 400 raft_consensus.cc:2229] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 3 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.792508 400 raft_consensus.cc:2258] T 3accccf29b0f42f29ccf26445c9c24a9 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.793746 400 tablet_replica.cc:330] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.793889 400 raft_consensus.cc:2229] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 4 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.794098 400 raft_consensus.cc:2258] T c2bd5e66b57b44dab99e935910c30ebb P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.794505 400 tablet_replica.cc:330] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.794615 400 raft_consensus.cc:2229] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.794740 400 raft_consensus.cc:2258] T 780cb8fe58324c80a31ca93e2dc76975 P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.795087 400 tablet_replica.cc:330] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.795210 400 raft_consensus.cc:2229] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.795325 400 raft_consensus.cc:2258] T 5366ac20e74b4e9a886754037bf78bac P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.795686 400 tablet_replica.cc:330] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.795790 400 raft_consensus.cc:2229] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.795907 400 raft_consensus.cc:2258] T 35802f0e6f7b46c89d30a69a86b72d7d P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.796260 400 tablet_replica.cc:330] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.796376 400 raft_consensus.cc:2229] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.796490 400 raft_consensus.cc:2258] T 01e9dabeca4843cf9c62c5b85c676eab P dadc37f905e3414782d795171cd11105 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.796847 400 tablet_replica.cc:330] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.796993 400 raft_consensus.cc:2229] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 3 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.797273 400 raft_consensus.cc:2258] T eebf179fe3f24593b357e64b8bcf66c9 P dadc37f905e3414782d795171cd11105 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.797670 400 tablet_replica.cc:330] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.797809 400 raft_consensus.cc:2229] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.797937 400 raft_consensus.cc:2258] T 10085ca24ddb4d5098b7abd0e5d5eb25 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.798328 400 tablet_replica.cc:330] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105: stopping tablet replica
I20240501 20:11:43.798444 400 raft_consensus.cc:2229] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.798583 400 raft_consensus.cc:2258] T bd7882a099d4410bb0664b9ff201a257 P dadc37f905e3414782d795171cd11105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.814468 400 tablet_server.cc:194] TabletServer@127.0.100.1:0 shutdown complete.
I20240501 20:11:43.820600 400 tablet_server.cc:178] TabletServer@127.0.100.2:0 shutting down...
W20240501 20:11:43.827416 646 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20240501 20:11:43.828900 400 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 20:11:43.829140 400 tablet_replica.cc:330] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.829324 400 raft_consensus.cc:2229] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Raft consensus shutting down.
W20240501 20:11:43.829349 646 consensus_peers.cc:485] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 -> Peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Couldn't send request to peer 5610b9abb5254acbafe12918f369617e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:11:43.829510 400 raft_consensus.cc:2258] T eebf179fe3f24593b357e64b8bcf66c9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.829978 400 tablet_replica.cc:330] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.830132 400 raft_consensus.cc:2229] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.830272 400 raft_consensus.cc:2258] T c2bd5e66b57b44dab99e935910c30ebb P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.830683 400 tablet_replica.cc:330] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.830812 400 raft_consensus.cc:2229] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.830950 400 raft_consensus.cc:2258] T 780cb8fe58324c80a31ca93e2dc76975 P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.831339 400 tablet_replica.cc:330] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.831478 400 raft_consensus.cc:2229] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.831600 400 raft_consensus.cc:2258] T 3accccf29b0f42f29ccf26445c9c24a9 P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.831990 400 tablet_replica.cc:330] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.832111 400 raft_consensus.cc:2229] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 4 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.832357 400 raft_consensus.cc:2258] T 5366ac20e74b4e9a886754037bf78bac P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.832731 400 tablet_replica.cc:330] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.832868 400 raft_consensus.cc:2229] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 3 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.833122 400 raft_consensus.cc:2258] T 35802f0e6f7b46c89d30a69a86b72d7d P 5610b9abb5254acbafe12918f369617e [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.833521 400 tablet_replica.cc:330] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.833643 400 raft_consensus.cc:2229] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.833778 400 raft_consensus.cc:2258] T 01e9dabeca4843cf9c62c5b85c676eab P 5610b9abb5254acbafe12918f369617e [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.834146 400 tablet_replica.cc:330] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.834283 400 raft_consensus.cc:2229] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 1 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.834497 400 raft_consensus.cc:2258] T 10085ca24ddb4d5098b7abd0e5d5eb25 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.834887 400 tablet_replica.cc:330] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e: stopping tablet replica
I20240501 20:11:43.835003 400 raft_consensus.cc:2229] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.835139 400 raft_consensus.cc:2258] T bd7882a099d4410bb0664b9ff201a257 P 5610b9abb5254acbafe12918f369617e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.849951 400 tablet_server.cc:194] TabletServer@127.0.100.2:0 shutdown complete.
I20240501 20:11:43.853734 400 tablet_server.cc:178] TabletServer@127.0.100.3:0 shutting down...
W20240501 20:11:43.859938 646 consensus_peers.cc:485] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 -> Peer 5610b9abb5254acbafe12918f369617e (127.0.100.2:36017): Couldn't send request to peer 5610b9abb5254acbafe12918f369617e. Status: Network error: Client connection negotiation failed: client connection to 127.0.100.2:36017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240501 20:11:43.862221 400 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 20:11:43.862439 400 tablet_replica.cc:330] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.862607 400 raft_consensus.cc:2229] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.862870 400 raft_consensus.cc:2258] T 780cb8fe58324c80a31ca93e2dc76975 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.863345 400 tablet_replica.cc:330] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.863482 400 raft_consensus.cc:2229] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.863610 400 raft_consensus.cc:2258] T 35802f0e6f7b46c89d30a69a86b72d7d P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.864015 400 tablet_replica.cc:330] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.864120 400 raft_consensus.cc:2229] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.864241 400 raft_consensus.cc:2258] T 5366ac20e74b4e9a886754037bf78bac P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.864580 400 tablet_replica.cc:330] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.864701 400 raft_consensus.cc:2229] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.864902 400 raft_consensus.cc:2258] T 01e9dabeca4843cf9c62c5b85c676eab P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.865319 400 tablet_replica.cc:330] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.865442 400 raft_consensus.cc:2229] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.865584 400 raft_consensus.cc:2258] T eebf179fe3f24593b357e64b8bcf66c9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.865949 400 tablet_replica.cc:330] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.866091 400 raft_consensus.cc:2229] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.866214 400 raft_consensus.cc:2258] T 10085ca24ddb4d5098b7abd0e5d5eb25 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.866595 400 tablet_replica.cc:330] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.866712 400 raft_consensus.cc:2229] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.866945 400 raft_consensus.cc:2258] T bd7882a099d4410bb0664b9ff201a257 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.867316 400 tablet_replica.cc:330] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.867447 400 raft_consensus.cc:2229] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.867581 400 raft_consensus.cc:2258] T c2bd5e66b57b44dab99e935910c30ebb P ff6dcd0fb7934d0d9de184137f1c6d67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.867970 400 tablet_replica.cc:330] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67: stopping tablet replica
I20240501 20:11:43.868098 400 raft_consensus.cc:2229] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:11:43.868245 400 raft_consensus.cc:2258] T 3accccf29b0f42f29ccf26445c9c24a9 P ff6dcd0fb7934d0d9de184137f1c6d67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.883792 400 tablet_server.cc:194] TabletServer@127.0.100.3:0 shutdown complete.
I20240501 20:11:43.887750 400 master.cc:537] Master@127.0.100.62:40261 shutting down...
I20240501 20:11:43.895543 400 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 1 LEADER]: Raft consensus shutting down.
I20240501 20:11:43.895733 400 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:11:43.895831 400 tablet_replica.cc:330] T 00000000000000000000000000000000 P f493f2681f0a465287b8e41af7ac2c16: stopping tablet replica
I20240501 20:11:43.908860 400 master.cc:552] Master@127.0.100.62:40261 shutdown complete.
5610b9abb5254acbafe12918f369617e 4
dadc37f905e3414782d795171cd11105 4
ff6dcd0fb7934d0d9de184137f1c6d67 1
5610b9abb5254acbafe12918f369617e 3
dadc37f905e3414782d795171cd11105 3
ff6dcd0fb7934d0d9de184137f1c6d67 3
5610b9abb5254acbafe12918f369617e 8
dadc37f905e3414782d795171cd11105 0
ff6dcd0fb7934d0d9de184137f1c6d67 1
5610b9abb5254acbafe12918f369617e 3
dadc37f905e3414782d795171cd11105 3
ff6dcd0fb7934d0d9de184137f1c6d67 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (27509 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240501 20:11:43.926218 400 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.100.62:40681
I20240501 20:11:43.926735 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:43.929853 885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:43.930933 886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:43.931728 888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:43.932473 400 server_base.cc:1034] running on GCE node
I20240501 20:11:43.932727 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:43.932781 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:43.932837 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594303932814 us; error 0 us; skew 500 ppm
I20240501 20:11:43.932976 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:43.939458 400 webserver.cc:460] Webserver started at http://127.0.100.62:39031/ using document root <none> and password file <none>
I20240501 20:11:43.939667 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:43.939741 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:43.939844 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:43.940480 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/master-0-root/instance:
uuid: "5cfa93c716294841a311114736d62502"
format_stamp: "Formatted at 2024-05-01 20:11:43 on dist-test-slave-hhxv"
I20240501 20:11:43.943106 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:11:43.944648 893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:43.944990 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 20:11:43.945119 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/master-0-root
uuid: "5cfa93c716294841a311114736d62502"
format_stamp: "Formatted at 2024-05-01 20:11:43 on dist-test-slave-hhxv"
I20240501 20:11:43.945251 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:43.960291 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:43.960814 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:43.973686 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.62:40681
I20240501 20:11:43.973742 944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.62:40681 every 8 connection(s)
I20240501 20:11:43.974992 945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:43.978881 945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502: Bootstrap starting.
I20240501 20:11:43.980090 945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:43.981607 945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502: No bootstrap required, opened a new log
I20240501 20:11:43.982223 945 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cfa93c716294841a311114736d62502" member_type: VOTER }
I20240501 20:11:43.982357 945 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:43.982443 945 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cfa93c716294841a311114736d62502, State: Initialized, Role: FOLLOWER
I20240501 20:11:43.982632 945 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cfa93c716294841a311114736d62502" member_type: VOTER }
I20240501 20:11:43.982774 945 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 20:11:43.982838 945 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 20:11:43.982936 945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:43.984567 945 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cfa93c716294841a311114736d62502" member_type: VOTER }
I20240501 20:11:43.984766 945 leader_election.cc:302] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cfa93c716294841a311114736d62502; no voters:
I20240501 20:11:43.985127 945 leader_election.cc:288] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 20:11:43.985242 948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:43.985669 948 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 1 LEADER]: Becoming Leader. State: Replica: 5cfa93c716294841a311114736d62502, State: Running, Role: LEADER
I20240501 20:11:43.985916 948 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cfa93c716294841a311114736d62502" member_type: VOTER }
I20240501 20:11:43.985985 945 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 20:11:43.987031 949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cfa93c716294841a311114736d62502" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cfa93c716294841a311114736d62502" member_type: VOTER } }
I20240501 20:11:43.987080 950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cfa93c716294841a311114736d62502. Latest consensus state: current_term: 1 leader_uuid: "5cfa93c716294841a311114736d62502" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cfa93c716294841a311114736d62502" member_type: VOTER } }
I20240501 20:11:43.987360 949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [sys.catalog]: This master's current role is: LEADER
I20240501 20:11:43.987396 950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [sys.catalog]: This master's current role is: LEADER
I20240501 20:11:43.988231 954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 20:11:43.989966 954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 20:11:43.991364 400 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 20:11:43.992795 954 catalog_manager.cc:1347] Generated new cluster ID: e42ff83a9b0c4846b94545fe7a74c45d
I20240501 20:11:43.992874 954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 20:11:44.005321 954 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 20:11:44.005990 954 catalog_manager.cc:1504] Loading token signing keys...
I20240501 20:11:44.011293 954 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502: Generated new TSK 0
I20240501 20:11:44.011469 954 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 20:11:44.023849 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:44.027172 966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:44.028154 967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:44.028988 969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:44.029680 400 server_base.cc:1034] running on GCE node
I20240501 20:11:44.029901 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:44.029971 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:44.030011 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594304029998 us; error 0 us; skew 500 ppm
I20240501 20:11:44.030135 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:44.031316 400 webserver.cc:460] Webserver started at http://127.0.100.1:45923/ using document root <none> and password file <none>
I20240501 20:11:44.031540 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:44.031606 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:44.031728 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:44.032291 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-0-root/instance:
uuid: "c18acb16190241b19009f0ab9fbb74fa"
format_stamp: "Formatted at 2024-05-01 20:11:44 on dist-test-slave-hhxv"
I20240501 20:11:44.034672 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:11:44.036124 974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.036439 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 20:11:44.036545 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-0-root
uuid: "c18acb16190241b19009f0ab9fbb74fa"
format_stamp: "Formatted at 2024-05-01 20:11:44 on dist-test-slave-hhxv"
I20240501 20:11:44.036664 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:44.062500 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:44.063088 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:44.063645 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:11:44.064488 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:11:44.064563 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.064669 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:11:44.064744 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.079834 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.1:41299
I20240501 20:11:44.079876 1036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.1:41299 every 8 connection(s)
I20240501 20:11:44.081418 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:44.084966 1041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:44.086424 1042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:44.086745 1044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:44.087477 400 server_base.cc:1034] running on GCE node
I20240501 20:11:44.087806 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:44.087884 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:44.087954 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594304087922 us; error 0 us; skew 500 ppm
I20240501 20:11:44.088122 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:44.089169 1037 heartbeater.cc:347] Connected to a master server at 127.0.100.62:40681
I20240501 20:11:44.089331 1037 heartbeater.cc:464] Registering TS with master...
I20240501 20:11:44.089705 1037 heartbeater.cc:511] Master 127.0.100.62:40681 requested a full tablet report, sending...
I20240501 20:11:44.089865 400 webserver.cc:460] Webserver started at http://127.0.100.2:40969/ using document root <none> and password file <none>
I20240501 20:11:44.090107 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:44.090226 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:44.090384 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:44.090678 910 ts_manager.cc:194] Registered new tserver with Master: c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299)
I20240501 20:11:44.091184 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-1-root/instance:
uuid: "2b8d071a68934c57869c1049f5a022c0"
format_stamp: "Formatted at 2024-05-01 20:11:44 on dist-test-slave-hhxv"
I20240501 20:11:44.092124 910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57114
I20240501 20:11:44.093906 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20240501 20:11:44.095355 1049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.095656 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 20:11:44.095757 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-1-root
uuid: "2b8d071a68934c57869c1049f5a022c0"
format_stamp: "Formatted at 2024-05-01 20:11:44 on dist-test-slave-hhxv"
I20240501 20:11:44.095880 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:44.114869 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:44.115442 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:44.115967 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:11:44.116772 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:11:44.116839 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.116945 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:11:44.116995 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.131043 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.2:43231
I20240501 20:11:44.131065 1111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.2:43231 every 8 connection(s)
I20240501 20:11:44.132525 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:11:44.136193 1115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:44.136942 1116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:11:44.137677 1118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:11:44.138363 400 server_base.cc:1034] running on GCE node
I20240501 20:11:44.138612 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:11:44.138680 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:11:44.138717 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594304138701 us; error 0 us; skew 500 ppm
I20240501 20:11:44.138828 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:11:44.139804 1112 heartbeater.cc:347] Connected to a master server at 127.0.100.62:40681
I20240501 20:11:44.139930 1112 heartbeater.cc:464] Registering TS with master...
I20240501 20:11:44.140110 400 webserver.cc:460] Webserver started at http://127.0.100.3:34049/ using document root <none> and password file <none>
I20240501 20:11:44.140314 1112 heartbeater.cc:511] Master 127.0.100.62:40681 requested a full tablet report, sending...
I20240501 20:11:44.140353 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:11:44.140415 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:11:44.140530 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:11:44.141208 910 ts_manager.cc:194] Registered new tserver with Master: 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:44.141290 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-2-root/instance:
uuid: "6167681550df4e21859170d0e86c1e23"
format_stamp: "Formatted at 2024-05-01 20:11:44 on dist-test-slave-hhxv"
I20240501 20:11:44.142216 910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57124
I20240501 20:11:44.143942 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:11:44.145407 1123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.145750 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 20:11:44.145852 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-2-root
uuid: "6167681550df4e21859170d0e86c1e23"
format_stamp: "Formatted at 2024-05-01 20:11:44 on dist-test-slave-hhxv"
I20240501 20:11:44.145968 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714594276349076-400-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:11:44.161387 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:11:44.161849 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:11:44.162369 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:11:44.163166 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:11:44.163247 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.163338 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:11:44.163406 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:11:44.179214 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.3:40033
I20240501 20:11:44.179265 1185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.3:40033 every 8 connection(s)
I20240501 20:11:44.185664 1186 heartbeater.cc:347] Connected to a master server at 127.0.100.62:40681
I20240501 20:11:44.185798 1186 heartbeater.cc:464] Registering TS with master...
I20240501 20:11:44.186156 1186 heartbeater.cc:511] Master 127.0.100.62:40681 requested a full tablet report, sending...
I20240501 20:11:44.186899 910 ts_manager.cc:194] Registered new tserver with Master: 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.187592 910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57134
I20240501 20:11:44.187981 400 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007901623s
I20240501 20:11:44.188936 400 test_util.cc:268] Using random seed: 409952739
I20240501 20:11:44.199590 910 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57136:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 20:11:44.200304 910 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 20:11:44.240440 1077 tablet_service.cc:1467] Processing CreateTablet for tablet 726143703cb94393823855ee208eebf4 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 20:11:44.240620 1076 tablet_service.cc:1467] Processing CreateTablet for tablet 810427b61b284ec2a4d4a44af6a00bd4 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 20:11:44.241080 1077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726143703cb94393823855ee208eebf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.241413 1076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 810427b61b284ec2a4d4a44af6a00bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.242949 1075 tablet_service.cc:1467] Processing CreateTablet for tablet adae83c692fd4436881365daa06ef546 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 20:11:44.245838 1075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adae83c692fd4436881365daa06ef546. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.247502 1000 tablet_service.cc:1467] Processing CreateTablet for tablet adae83c692fd4436881365daa06ef546 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 20:11:44.247951 1000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adae83c692fd4436881365daa06ef546. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.248091 1148 tablet_service.cc:1467] Processing CreateTablet for tablet 7a04dac2b2d342e3b66ae400f459534f (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 20:11:44.248545 1148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a04dac2b2d342e3b66ae400f459534f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.249480 1001 tablet_service.cc:1467] Processing CreateTablet for tablet 810427b61b284ec2a4d4a44af6a00bd4 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 20:11:44.249545 995 tablet_service.cc:1467] Processing CreateTablet for tablet e7b620c1a0b048c290ce30499fc63735 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 20:11:44.249928 1001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 810427b61b284ec2a4d4a44af6a00bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.250331 997 tablet_service.cc:1467] Processing CreateTablet for tablet d229eda84478481da33affd131762a02 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 20:11:44.250777 997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d229eda84478481da33affd131762a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.251624 1149 tablet_service.cc:1467] Processing CreateTablet for tablet adae83c692fd4436881365daa06ef546 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 20:11:44.252063 1149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adae83c692fd4436881365daa06ef546. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.253463 1146 tablet_service.cc:1467] Processing CreateTablet for tablet d229eda84478481da33affd131762a02 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 20:11:44.253908 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d229eda84478481da33affd131762a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.256345 999 tablet_service.cc:1467] Processing CreateTablet for tablet 7a04dac2b2d342e3b66ae400f459534f (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 20:11:44.256785 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a04dac2b2d342e3b66ae400f459534f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.257464 995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b620c1a0b048c290ce30499fc63735. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.257850 1142 tablet_service.cc:1467] Processing CreateTablet for tablet f74560ac446240e18b69a37e4e6ee7cf (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 20:11:44.258298 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f74560ac446240e18b69a37e4e6ee7cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.257467 1144 tablet_service.cc:1467] Processing CreateTablet for tablet e7b620c1a0b048c290ce30499fc63735 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 20:11:44.261432 1147 tablet_service.cc:1467] Processing CreateTablet for tablet 1db73de80b83439381a97e9190d71900 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 20:11:44.261611 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b620c1a0b048c290ce30499fc63735. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.261910 1147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1db73de80b83439381a97e9190d71900. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.262132 1201 tablet_bootstrap.cc:492] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.263813 998 tablet_service.cc:1467] Processing CreateTablet for tablet 1db73de80b83439381a97e9190d71900 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 20:11:44.264317 998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1db73de80b83439381a97e9190d71900. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.264376 1074 tablet_service.cc:1467] Processing CreateTablet for tablet 7a04dac2b2d342e3b66ae400f459534f (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 20:11:44.264789 1074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a04dac2b2d342e3b66ae400f459534f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.265506 993 tablet_service.cc:1467] Processing CreateTablet for tablet f74560ac446240e18b69a37e4e6ee7cf (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 20:11:44.265966 993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f74560ac446240e18b69a37e4e6ee7cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.265934 1002 tablet_service.cc:1467] Processing CreateTablet for tablet 726143703cb94393823855ee208eebf4 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 20:11:44.265990 1070 tablet_service.cc:1467] Processing CreateTablet for tablet e7b620c1a0b048c290ce30499fc63735 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 20:11:44.266294 1069 tablet_service.cc:1467] Processing CreateTablet for tablet d3e09b6d7b8f4cc1956ff50b14a185f6 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 20:11:44.266436 1002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726143703cb94393823855ee208eebf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.267058 1068 tablet_service.cc:1467] Processing CreateTablet for tablet f74560ac446240e18b69a37e4e6ee7cf (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 20:11:44.267172 1071 tablet_service.cc:1467] Processing CreateTablet for tablet d3f76db3827a45c585b51abf909c5247 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 20:11:44.266443 1070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7b620c1a0b048c290ce30499fc63735. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.267313 1143 tablet_service.cc:1467] Processing CreateTablet for tablet d3e09b6d7b8f4cc1956ff50b14a185f6 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 20:11:44.267621 1071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3f76db3827a45c585b51abf909c5247. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.267774 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3e09b6d7b8f4cc1956ff50b14a185f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.267832 1073 tablet_service.cc:1467] Processing CreateTablet for tablet 1db73de80b83439381a97e9190d71900 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 20:11:44.268286 1073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1db73de80b83439381a97e9190d71900. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.269214 996 tablet_service.cc:1467] Processing CreateTablet for tablet d3f76db3827a45c585b51abf909c5247 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 20:11:44.269654 1151 tablet_service.cc:1467] Processing CreateTablet for tablet 726143703cb94393823855ee208eebf4 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 20:11:44.270088 1151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726143703cb94393823855ee208eebf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.270068 1145 tablet_service.cc:1467] Processing CreateTablet for tablet d3f76db3827a45c585b51abf909c5247 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 20:11:44.270495 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3f76db3827a45c585b51abf909c5247. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.269655 996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3f76db3827a45c585b51abf909c5247. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.273432 1069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3e09b6d7b8f4cc1956ff50b14a185f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.273823 1072 tablet_service.cc:1467] Processing CreateTablet for tablet d229eda84478481da33affd131762a02 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 20:11:44.275440 1068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f74560ac446240e18b69a37e4e6ee7cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.275478 994 tablet_service.cc:1467] Processing CreateTablet for tablet d3e09b6d7b8f4cc1956ff50b14a185f6 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 20:11:44.274677 1150 tablet_service.cc:1467] Processing CreateTablet for tablet 810427b61b284ec2a4d4a44af6a00bd4 (DEFAULT_TABLE table=test-workload [id=047763701ff04b02be24663d116fbcf8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 20:11:44.276752 1072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d229eda84478481da33affd131762a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.280485 994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3e09b6d7b8f4cc1956ff50b14a185f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.285529 1150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 810427b61b284ec2a4d4a44af6a00bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:11:44.327708 1201 tablet_bootstrap.cc:654] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.328297 1202 tablet_bootstrap.cc:492] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.350600 1203 tablet_bootstrap.cc:492] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.353511 1202 tablet_bootstrap.cc:654] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.354358 1203 tablet_bootstrap.cc:654] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.354800 1201 tablet_bootstrap.cc:492] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.354967 1201 ts_tablet_manager.cc:1367] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.093s user 0.005s sys 0.001s
I20240501 20:11:44.355727 1201 raft_consensus.cc:348] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.355947 1201 raft_consensus.cc:374] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.356053 1201 raft_consensus.cc:729] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.356226 1202 tablet_bootstrap.cc:492] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.356366 1202 ts_tablet_manager.cc:1367] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20240501 20:11:44.356315 1201 consensus_queue.cc:260] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.357188 1037 heartbeater.cc:503] Master 127.0.100.62:40681 was elected leader, sending a full tablet report...
I20240501 20:11:44.357132 1202 raft_consensus.cc:348] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.357306 1202 raft_consensus.cc:374] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.357404 1202 raft_consensus.cc:729] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.357630 1202 consensus_queue.cc:260] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.358161 1201 ts_tablet_manager.cc:1398] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240501 20:11:44.358448 1201 tablet_bootstrap.cc:492] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.360112 1201 tablet_bootstrap.cc:654] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.362336 1203 tablet_bootstrap.cc:492] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.362483 1203 ts_tablet_manager.cc:1367] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.008s
I20240501 20:11:44.363150 1203 raft_consensus.cc:348] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.363315 1203 raft_consensus.cc:374] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.363418 1203 raft_consensus.cc:729] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.363642 1203 consensus_queue.cc:260] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.366010 1202 ts_tablet_manager.cc:1398] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.009s user 0.007s sys 0.003s
I20240501 20:11:44.366134 1186 heartbeater.cc:503] Master 127.0.100.62:40681 was elected leader, sending a full tablet report...
I20240501 20:11:44.366178 1112 heartbeater.cc:503] Master 127.0.100.62:40681 was elected leader, sending a full tablet report...
I20240501 20:11:44.366469 1202 tablet_bootstrap.cc:492] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.366266 1203 ts_tablet_manager.cc:1398] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20240501 20:11:44.366894 1203 tablet_bootstrap.cc:492] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.368036 1201 tablet_bootstrap.cc:492] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.368115 1202 tablet_bootstrap.cc:654] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.368309 1201 ts_tablet_manager.cc:1367] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20240501 20:11:44.369158 1201 raft_consensus.cc:348] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.369455 1201 raft_consensus.cc:374] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.369504 1203 tablet_bootstrap.cc:654] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.369634 1201 raft_consensus.cc:729] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.369977 1201 consensus_queue.cc:260] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.370540 1201 ts_tablet_manager.cc:1398] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:11:44.372068 1201 tablet_bootstrap.cc:492] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.373711 1201 tablet_bootstrap.cc:654] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.375995 1202 tablet_bootstrap.cc:492] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.376155 1202 ts_tablet_manager.cc:1367] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20240501 20:11:44.377497 1202 raft_consensus.cc:348] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.377728 1202 raft_consensus.cc:374] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.377811 1202 raft_consensus.cc:729] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.377871 1203 tablet_bootstrap.cc:492] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.378031 1203 ts_tablet_manager.cc:1367] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20240501 20:11:44.378085 1202 consensus_queue.cc:260] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.378629 1202 ts_tablet_manager.cc:1398] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:44.378922 1202 tablet_bootstrap.cc:492] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.378832 1203 raft_consensus.cc:348] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.379040 1203 raft_consensus.cc:374] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.379127 1203 raft_consensus.cc:729] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.379339 1203 consensus_queue.cc:260] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.379805 1203 ts_tablet_manager.cc:1398] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:11:44.380064 1203 tablet_bootstrap.cc:492] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.380455 1202 tablet_bootstrap.cc:654] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.381367 1203 tablet_bootstrap.cc:654] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.383332 1202 tablet_bootstrap.cc:492] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.383481 1202 ts_tablet_manager.cc:1367] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240501 20:11:44.384243 1202 raft_consensus.cc:348] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.384455 1202 raft_consensus.cc:374] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.384552 1202 raft_consensus.cc:729] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.384892 1202 consensus_queue.cc:260] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.385422 1203 tablet_bootstrap.cc:492] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.385463 1202 ts_tablet_manager.cc:1398] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:44.385577 1203 ts_tablet_manager.cc:1367] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240501 20:11:44.385692 1202 tablet_bootstrap.cc:492] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.386881 1203 raft_consensus.cc:348] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.387077 1203 raft_consensus.cc:374] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.387163 1203 raft_consensus.cc:729] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.387414 1203 consensus_queue.cc:260] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.387694 1202 tablet_bootstrap.cc:654] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.388769 1203 ts_tablet_manager.cc:1398] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 20:11:44.389104 1203 tablet_bootstrap.cc:492] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.389317 1201 tablet_bootstrap.cc:492] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.389446 1201 ts_tablet_manager.cc:1367] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.007s
I20240501 20:11:44.390308 1201 raft_consensus.cc:348] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.390491 1201 raft_consensus.cc:374] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.390589 1201 raft_consensus.cc:729] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.390828 1201 consensus_queue.cc:260] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.390952 1203 tablet_bootstrap.cc:654] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.392011 1201 ts_tablet_manager.cc:1398] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:44.392300 1201 tablet_bootstrap.cc:492] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.393853 1201 tablet_bootstrap.cc:654] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.397440 1201 tablet_bootstrap.cc:492] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.397583 1201 ts_tablet_manager.cc:1367] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 20:11:44.397835 1203 tablet_bootstrap.cc:492] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.397965 1203 ts_tablet_manager.cc:1367] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20240501 20:11:44.398101 1201 raft_consensus.cc:348] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.398265 1201 raft_consensus.cc:374] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.398334 1201 raft_consensus.cc:729] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.398545 1201 consensus_queue.cc:260] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.398545 1203 raft_consensus.cc:348] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.398746 1203 raft_consensus.cc:374] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.398821 1203 raft_consensus.cc:729] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.399009 1201 ts_tablet_manager.cc:1398] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240501 20:11:44.399061 1203 consensus_queue.cc:260] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.399289 1201 tablet_bootstrap.cc:492] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.399544 1203 ts_tablet_manager.cc:1398] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:11:44.399806 1203 tablet_bootstrap.cc:492] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.400786 1201 tablet_bootstrap.cc:654] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.401252 1203 tablet_bootstrap.cc:654] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.402415 1202 tablet_bootstrap.cc:492] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.403143 1202 ts_tablet_manager.cc:1367] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.008s
I20240501 20:11:44.403873 1201 tablet_bootstrap.cc:492] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.403848 1202 raft_consensus.cc:348] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.403993 1201 ts_tablet_manager.cc:1367] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 20:11:44.404039 1202 raft_consensus.cc:374] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.404119 1202 raft_consensus.cc:729] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.404433 1202 consensus_queue.cc:260] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.404711 1201 raft_consensus.cc:348] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.404907 1201 raft_consensus.cc:374] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.405009 1201 raft_consensus.cc:729] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.405014 1202 ts_tablet_manager.cc:1398] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:11:44.405331 1202 tablet_bootstrap.cc:492] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.405258 1201 consensus_queue.cc:260] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.405858 1201 ts_tablet_manager.cc:1398] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:44.406131 1201 tablet_bootstrap.cc:492] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.406926 1202 tablet_bootstrap.cc:654] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.407691 1201 tablet_bootstrap.cc:654] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.409371 1203 tablet_bootstrap.cc:492] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.409518 1203 ts_tablet_manager.cc:1367] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20240501 20:11:44.410259 1203 raft_consensus.cc:348] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.410459 1203 raft_consensus.cc:374] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.410557 1203 raft_consensus.cc:729] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.410789 1203 consensus_queue.cc:260] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.411320 1203 ts_tablet_manager.cc:1398] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:11:44.411579 1203 tablet_bootstrap.cc:492] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.413226 1203 tablet_bootstrap.cc:654] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.417241 1201 tablet_bootstrap.cc:492] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.417245 1202 tablet_bootstrap.cc:492] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.417368 1201 ts_tablet_manager.cc:1367] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.008s
I20240501 20:11:44.417418 1202 ts_tablet_manager.cc:1367] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.004s
I20240501 20:11:44.417654 1203 tablet_bootstrap.cc:492] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.417848 1203 ts_tablet_manager.cc:1367] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.004s
I20240501 20:11:44.417843 1201 raft_consensus.cc:348] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.418088 1201 raft_consensus.cc:374] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.418192 1201 raft_consensus.cc:729] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.418139 1202 raft_consensus.cc:348] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.418341 1202 raft_consensus.cc:374] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.418457 1202 raft_consensus.cc:729] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.418499 1201 consensus_queue.cc:260] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.418604 1203 raft_consensus.cc:348] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.418685 1202 consensus_queue.cc:260] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.418802 1203 raft_consensus.cc:374] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.418882 1203 raft_consensus.cc:729] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.419003 1201 ts_tablet_manager.cc:1398] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:11:44.419234 1202 ts_tablet_manager.cc:1398] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:44.419138 1203 consensus_queue.cc:260] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.419283 1201 tablet_bootstrap.cc:492] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.419486 1202 tablet_bootstrap.cc:492] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.419595 1203 ts_tablet_manager.cc:1398] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:11:44.419835 1203 tablet_bootstrap.cc:492] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.421172 1202 tablet_bootstrap.cc:654] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.421334 1203 tablet_bootstrap.cc:654] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.423848 1201 tablet_bootstrap.cc:654] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.427012 1201 tablet_bootstrap.cc:492] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.427136 1201 ts_tablet_manager.cc:1367] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.003s
I20240501 20:11:44.427450 1202 tablet_bootstrap.cc:492] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.427598 1203 tablet_bootstrap.cc:492] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.427605 1202 ts_tablet_manager.cc:1367] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20240501 20:11:44.427732 1203 ts_tablet_manager.cc:1367] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20240501 20:11:44.427773 1201 raft_consensus.cc:348] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.427955 1201 raft_consensus.cc:374] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.428056 1201 raft_consensus.cc:729] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.428285 1201 consensus_queue.cc:260] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.428345 1202 raft_consensus.cc:348] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.428409 1203 raft_consensus.cc:348] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.428602 1203 raft_consensus.cc:374] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.428608 1202 raft_consensus.cc:374] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.428702 1203 raft_consensus.cc:729] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.428720 1202 raft_consensus.cc:729] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.428802 1201 ts_tablet_manager.cc:1398] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:11:44.429085 1201 tablet_bootstrap.cc:492] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.428972 1202 consensus_queue.cc:260] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.428932 1203 consensus_queue.cc:260] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.429689 1203 ts_tablet_manager.cc:1398] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:11:44.429949 1203 tablet_bootstrap.cc:492] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.431692 1201 tablet_bootstrap.cc:654] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.432744 1203 tablet_bootstrap.cc:654] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.433614 1202 ts_tablet_manager.cc:1398] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 20:11:44.433913 1202 tablet_bootstrap.cc:492] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.435425 1202 tablet_bootstrap.cc:654] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.437168 1201 tablet_bootstrap.cc:492] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.437332 1201 ts_tablet_manager.cc:1367] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20240501 20:11:44.438073 1203 tablet_bootstrap.cc:492] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.438136 1201 raft_consensus.cc:348] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.438251 1203 ts_tablet_manager.cc:1367] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20240501 20:11:44.438324 1201 raft_consensus.cc:374] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.438418 1201 raft_consensus.cc:729] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.438659 1201 consensus_queue.cc:260] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.438732 1202 tablet_bootstrap.cc:492] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.438917 1202 ts_tablet_manager.cc:1367] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240501 20:11:44.438997 1203 raft_consensus.cc:348] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.439110 1201 ts_tablet_manager.cc:1398] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:11:44.439204 1203 raft_consensus.cc:374] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.439285 1203 raft_consensus.cc:729] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.439404 1201 tablet_bootstrap.cc:492] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.439540 1203 consensus_queue.cc:260] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.439662 1202 raft_consensus.cc:348] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.439816 1202 raft_consensus.cc:374] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.440383 1202 raft_consensus.cc:729] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.440635 1202 consensus_queue.cc:260] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.441179 1203 ts_tablet_manager.cc:1398] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:11:44.441226 1202 ts_tablet_manager.cc:1398] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 20:11:44.441470 1202 tablet_bootstrap.cc:492] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.441466 1201 tablet_bootstrap.cc:654] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.441471 1203 tablet_bootstrap.cc:492] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.443070 1203 tablet_bootstrap.cc:654] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.443099 1202 tablet_bootstrap.cc:654] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.449524 1201 tablet_bootstrap.cc:492] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.449669 1201 ts_tablet_manager.cc:1367] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20240501 20:11:44.450449 1201 raft_consensus.cc:348] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.450619 1201 raft_consensus.cc:374] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.450709 1201 raft_consensus.cc:729] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.450940 1201 consensus_queue.cc:260] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.451192 1203 tablet_bootstrap.cc:492] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.451351 1203 ts_tablet_manager.cc:1367] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20240501 20:11:44.451586 1202 tablet_bootstrap.cc:492] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.452072 1201 ts_tablet_manager.cc:1398] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:11:44.452360 1201 tablet_bootstrap.cc:492] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa: Bootstrap starting.
I20240501 20:11:44.453146 1202 ts_tablet_manager.cc:1367] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20240501 20:11:44.453465 1203 raft_consensus.cc:348] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.453789 1203 raft_consensus.cc:374] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.453999 1201 tablet_bootstrap.cc:654] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.453987 1202 raft_consensus.cc:348] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.454227 1202 raft_consensus.cc:374] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.454332 1202 raft_consensus.cc:729] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.454344 1203 raft_consensus.cc:729] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.454668 1203 consensus_queue.cc:260] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.454653 1202 consensus_queue.cc:260] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.455868 1202 ts_tablet_manager.cc:1398] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 20:11:44.455870 1203 ts_tablet_manager.cc:1398] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240501 20:11:44.456171 1202 tablet_bootstrap.cc:492] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.456265 1203 tablet_bootstrap.cc:492] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0: Bootstrap starting.
I20240501 20:11:44.456662 1210 raft_consensus.cc:482] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.456816 1210 raft_consensus.cc:504] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.457823 1202 tablet_bootstrap.cc:654] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.457927 1210 leader_election.cc:288] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.463582 1201 tablet_bootstrap.cc:492] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa: No bootstrap required, opened a new log
I20240501 20:11:44.463754 1201 ts_tablet_manager.cc:1367] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.010s
I20240501 20:11:44.464463 1201 raft_consensus.cc:348] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.464715 1201 raft_consensus.cc:374] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.464807 1201 raft_consensus.cc:729] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.465090 1201 consensus_queue.cc:260] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.466535 1207 raft_consensus.cc:482] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.466670 1207 raft_consensus.cc:504] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.470584 1201 ts_tablet_manager.cc:1398] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240501 20:11:44.471843 1207 leader_election.cc:288] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.482574 1203 tablet_bootstrap.cc:654] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.487977 1210 raft_consensus.cc:482] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.488369 1210 raft_consensus.cc:504] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.489152 1210 leader_election.cc:288] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.491042 1202 tablet_bootstrap.cc:492] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.491346 1202 ts_tablet_manager.cc:1367] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.016s
I20240501 20:11:44.492843 1207 raft_consensus.cc:482] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.493018 1207 raft_consensus.cc:504] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.493721 1207 leader_election.cc:288] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.494170 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.495186 1202 raft_consensus.cc:348] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.495265 1011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa" is_pre_election: true
I20240501 20:11:44.495426 1202 raft_consensus.cc:374] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.495229 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa" is_pre_election: true
I20240501 20:11:44.495536 1011 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.495585 1202 raft_consensus.cc:729] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.495649 1012 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.495829 1202 consensus_queue.cc:260] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.496402 1202 ts_tablet_manager.cc:1398] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240501 20:11:44.496783 1202 tablet_bootstrap.cc:492] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23: Bootstrap starting.
I20240501 20:11:44.497363 1087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.498118 1087 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.498517 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae83c692fd4436881365daa06ef546" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.498780 1086 raft_consensus.cc:2454] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.499015 1202 tablet_bootstrap.cc:654] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23: Neither blocks nor log segments found. Creating new log.
I20240501 20:11:44.499269 975 leader_election.cc:302] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.499559 975 leader_election.cc:302] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.499915 1207 raft_consensus.cc:2781] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.500012 1207 raft_consensus.cc:482] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.500142 1207 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.503551 1207 raft_consensus.cc:504] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.504220 1207 leader_election.cc:288] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.504395 1207 raft_consensus.cc:2781] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.504506 1207 raft_consensus.cc:482] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.504596 1207 raft_consensus.cc:3037] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.506110 1161 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.494328 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.506502 1160 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.507042 1051 leader_election.cc:302] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.507328 1210 raft_consensus.cc:2781] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.507431 1210 raft_consensus.cc:482] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.507560 1210 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.507592 1051 leader_election.cc:302] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.510576 1210 raft_consensus.cc:504] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.511425 1210 leader_election.cc:288] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.511615 1210 raft_consensus.cc:2781] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.511719 1210 raft_consensus.cc:482] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.511808 1210 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.514637 1210 raft_consensus.cc:504] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.520588 1207 raft_consensus.cc:504] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.521236 1207 leader_election.cc:288] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.521435 1207 raft_consensus.cc:482] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.521580 1207 raft_consensus.cc:504] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.522114 1207 leader_election.cc:288] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.522382 1210 leader_election.cc:288] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.523247 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.523458 1160 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.526645 1160 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 1.
I20240501 20:11:44.527537 1242 raft_consensus.cc:482] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.527678 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.527712 1242 raft_consensus.cc:504] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.527563 1051 leader_election.cc:302] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.528214 1210 raft_consensus.cc:2781] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.527910 1160 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.528668 1242 leader_election.cc:288] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.532467 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.532763 1161 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.533269 1051 leader_election.cc:302] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.533524 1242 raft_consensus.cc:2781] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.533635 1242 raft_consensus.cc:482] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.533722 1242 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.534497 1160 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 1.
I20240501 20:11:44.535274 1051 leader_election.cc:302] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.536527 1242 raft_consensus.cc:504] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.537384 1242 leader_election.cc:288] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.537598 1242 raft_consensus.cc:2781] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.537717 1242 raft_consensus.cc:686] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:44.538010 1242 consensus_queue.cc:237] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.539431 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.539630 1160 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.541695 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:44.541944 1012 raft_consensus.cc:2379] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b8d071a68934c57869c1049f5a022c0 in current term 1: Already voted for candidate c18acb16190241b19009f0ab9fbb74fa in this term.
I20240501 20:11:44.542685 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:44.542865 1012 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.545856 1012 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 1.
I20240501 20:11:44.546689 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa" is_pre_election: true
I20240501 20:11:44.547533 1012 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.548166 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:44.548354 1012 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.551183 1012 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 1.
I20240501 20:11:44.552774 1052 leader_election.cc:302] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.553650 1245 raft_consensus.cc:2781] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.553864 1245 raft_consensus.cc:686] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:44.553975 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.554236 1161 raft_consensus.cc:2379] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c18acb16190241b19009f0ab9fbb74fa in current term 1: Already voted for candidate 2b8d071a68934c57869c1049f5a022c0 in this term.
I20240501 20:11:44.554503 1245 consensus_queue.cc:237] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.555100 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae83c692fd4436881365daa06ef546" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.555436 1161 raft_consensus.cc:2454] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.555678 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.556047 1159 raft_consensus.cc:2379] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c18acb16190241b19009f0ab9fbb74fa in current term 1: Already voted for candidate 2b8d071a68934c57869c1049f5a022c0 in this term.
I20240501 20:11:44.556785 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae83c692fd4436881365daa06ef546" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.556957 1159 raft_consensus.cc:3037] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.559995 1159 raft_consensus.cc:2454] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 1.
I20240501 20:11:44.560686 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.561576 976 leader_election.cc:302] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.563751 1160 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 1.
I20240501 20:11:44.565157 1207 raft_consensus.cc:2781] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.565313 1207 raft_consensus.cc:686] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:44.565577 1207 consensus_queue.cc:237] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.568533 1210 raft_consensus.cc:686] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:44.568822 1210 consensus_queue.cc:237] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
W20240501 20:11:44.571846 975 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.100.2:43231, user_credentials={real_user=slave}} blocked reactor thread for 72285.4us
I20240501 20:11:44.571779 909 catalog_manager.cc:5484] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.572402 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.573202 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae83c692fd4436881365daa06ef546" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.573388 1086 raft_consensus.cc:3037] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.576112 1086 raft_consensus.cc:2454] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 1.
I20240501 20:11:44.576742 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.577373 975 leader_election.cc:302] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18acb16190241b19009f0ab9fbb74fa; no voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23
I20240501 20:11:44.577672 1207 raft_consensus.cc:482] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.577479 909 catalog_manager.cc:5484] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.577811 1207 raft_consensus.cc:504] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.578027 909 catalog_manager.cc:5484] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.578476 1207 leader_election.cc:288] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.578639 1207 raft_consensus.cc:2726] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240501 20:11:44.579236 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.579442 1160 raft_consensus.cc:2454] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.579783 976 leader_election.cc:302] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.580071 1239 raft_consensus.cc:2781] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.580185 1239 raft_consensus.cc:482] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.580332 1239 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.583247 1239 raft_consensus.cc:504] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.584298 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.584494 1159 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.587503 1159 raft_consensus.cc:2454] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 1.
I20240501 20:11:44.587962 976 leader_election.cc:302] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.588249 1207 raft_consensus.cc:2781] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.588374 1207 raft_consensus.cc:686] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:44.588711 1207 consensus_queue.cc:237] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.590467 975 leader_election.cc:302] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c18acb16190241b19009f0ab9fbb74fa; no voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23
I20240501 20:11:44.590831 1207 raft_consensus.cc:2726] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:11:44.591629 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.592231 1207 raft_consensus.cc:482] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.592413 1207 raft_consensus.cc:504] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.593086 1207 leader_election.cc:288] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.593676 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.594496 1160 raft_consensus.cc:2454] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.594861 976 leader_election.cc:302] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.595101 1207 raft_consensus.cc:2781] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.595237 1207 raft_consensus.cc:482] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.595329 1207 raft_consensus.cc:3037] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.598369 1207 raft_consensus.cc:504] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.598974 1207 leader_election.cc:288] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.599522 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.599722 1159 raft_consensus.cc:3037] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.602612 1159 raft_consensus.cc:2454] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 1.
I20240501 20:11:44.603153 976 leader_election.cc:302] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.603456 1207 raft_consensus.cc:2781] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.603582 1207 raft_consensus.cc:686] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:44.603929 1207 consensus_queue.cc:237] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.605311 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.606032 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.606258 1086 raft_consensus.cc:2454] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.606948 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.607157 1086 raft_consensus.cc:3037] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.610118 1086 raft_consensus.cc:2454] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 1.
W20240501 20:11:44.610538 975 leader_election.cc:341] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:11:44.610893 975 leader_election.cc:341] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:11:44.611356 1239 leader_election.cc:288] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.613246 1203 tablet_bootstrap.cc:492] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0: No bootstrap required, opened a new log
I20240501 20:11:44.612938 909 catalog_manager.cc:5484] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 0 to 1, leader changed from <none> to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 1 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.613471 1202 tablet_bootstrap.cc:492] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23: No bootstrap required, opened a new log
I20240501 20:11:44.613476 1203 ts_tablet_manager.cc:1367] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0: Time spent bootstrapping tablet: real 0.157s user 0.050s sys 0.069s
I20240501 20:11:44.613636 1202 ts_tablet_manager.cc:1367] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23: Time spent bootstrapping tablet: real 0.117s user 0.020s sys 0.040s
I20240501 20:11:44.614316 1202 raft_consensus.cc:348] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.614285 1203 raft_consensus.cc:348] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.614548 1202 raft_consensus.cc:374] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.614557 1203 raft_consensus.cc:374] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:11:44.614641 1202 raft_consensus.cc:729] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.614663 1203 raft_consensus.cc:729] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Initialized, Role: FOLLOWER
I20240501 20:11:44.614928 1202 consensus_queue.cc:260] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.614900 1203 consensus_queue.cc:260] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.615440 1203 ts_tablet_manager.cc:1398] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:11:44.616313 1202 ts_tablet_manager.cc:1398] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 20:11:44.619058 910 catalog_manager.cc:5484] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 0 to 1, leader changed from <none> to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 1 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.619588 910 catalog_manager.cc:5484] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 0 to 1, leader changed from <none> to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 1 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.619969 1242 raft_consensus.cc:482] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.620096 1242 raft_consensus.cc:504] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.620605 1242 leader_election.cc:288] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.621003 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.621222 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa" is_pre_election: true
I20240501 20:11:44.621282 1160 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.621402 1012 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 0.
I20240501 20:11:44.621590 1051 leader_election.cc:302] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.621817 1242 raft_consensus.cc:2781] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.621905 1242 raft_consensus.cc:482] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.622009 1242 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.623855 1242 raft_consensus.cc:504] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.624315 1242 leader_election.cc:288] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.624660 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:44.624662 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.624850 1012 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.624864 1160 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.626717 1160 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 1.
I20240501 20:11:44.626724 1012 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 1.
I20240501 20:11:44.627034 1051 leader_election.cc:302] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.627275 1242 raft_consensus.cc:2781] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.627421 1242 raft_consensus.cc:686] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:44.627660 1242 consensus_queue.cc:237] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.629750 910 catalog_manager.cc:5484] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.644253 1208 raft_consensus.cc:482] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.644395 1208 raft_consensus.cc:504] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.645638 1208 leader_election.cc:288] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:44.652186 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa" is_pre_election: true
I20240501 20:11:44.652379 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.652433 1012 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 0.
I20240501 20:11:44.652580 1086 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 0.
I20240501 20:11:44.652855 1126 leader_election.cc:302] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.653308 1208 raft_consensus.cc:2781] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.653427 1208 raft_consensus.cc:482] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.653513 1208 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.654714 1253 raft_consensus.cc:482] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.654879 1253 raft_consensus.cc:504] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.655633 1253 leader_election.cc:288] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:44.655928 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa" is_pre_election: true
I20240501 20:11:44.656033 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.656116 1012 raft_consensus.cc:2454] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 0.
I20240501 20:11:44.656252 1086 raft_consensus.cc:2454] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 0.
I20240501 20:11:44.656199 1208 raft_consensus.cc:504] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.656492 1126 leader_election.cc:302] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.656724 1253 raft_consensus.cc:2781] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.656757 1208 leader_election.cc:288] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:44.656888 1253 raft_consensus.cc:482] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.656998 1253 raft_consensus.cc:3037] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.657249 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.657292 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:44.657444 1086 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.657541 1012 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.659171 1253 raft_consensus.cc:504] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.659670 1253 leader_election.cc:288] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:44.659997 1011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:44.660586 1011 raft_consensus.cc:3037] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.660596 1087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.660668 1086 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 1.
I20240501 20:11:44.660799 1087 raft_consensus.cc:3037] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.661018 1012 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 1.
I20240501 20:11:44.661088 1124 leader_election.cc:302] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:44.661377 1253 raft_consensus.cc:2781] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.661494 1253 raft_consensus.cc:686] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Becoming Leader. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:44.661803 1253 consensus_queue.cc:237] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.663589 1011 raft_consensus.cc:2454] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 1.
I20240501 20:11:44.664109 1126 leader_election.cc:302] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.664346 910 catalog_manager.cc:5484] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6167681550df4e21859170d0e86c1e23 (127.0.100.3). New cstate: current_term: 1 leader_uuid: "6167681550df4e21859170d0e86c1e23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:44.664579 1087 raft_consensus.cc:2454] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 1.
I20240501 20:11:44.664781 1253 raft_consensus.cc:2781] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.664943 1253 raft_consensus.cc:686] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Becoming Leader. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:44.665248 1253 consensus_queue.cc:237] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.668383 910 catalog_manager.cc:5484] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6167681550df4e21859170d0e86c1e23 (127.0.100.3). New cstate: current_term: 1 leader_uuid: "6167681550df4e21859170d0e86c1e23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:44.685875 1241 raft_consensus.cc:482] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:11:44.686064 1241 raft_consensus.cc:504] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.686734 1241 leader_election.cc:288] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.687160 1087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0" is_pre_election: true
I20240501 20:11:44.687165 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23" is_pre_election: true
I20240501 20:11:44.687402 1087 raft_consensus.cc:2454] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.687398 1160 raft_consensus.cc:2454] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 0.
I20240501 20:11:44.687788 975 leader_election.cc:302] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.688030 1241 raft_consensus.cc:2781] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:11:44.688134 1241 raft_consensus.cc:482] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:11:44.688227 1241 raft_consensus.cc:3037] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.690675 1241 raft_consensus.cc:504] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.691185 1241 leader_election.cc:288] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.691534 1087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.691577 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.691728 1087 raft_consensus.cc:3037] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.691759 1160 raft_consensus.cc:3037] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.693660 1087 raft_consensus.cc:2454] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 1.
I20240501 20:11:44.693781 1160 raft_consensus.cc:2454] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 1.
I20240501 20:11:44.694012 975 leader_election.cc:302] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.694258 1241 raft_consensus.cc:2781] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:11:44.694391 1241 raft_consensus.cc:686] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:44.694733 1241 consensus_queue.cc:237] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.697407 910 catalog_manager.cc:5484] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 0 to 1, leader changed from <none> to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 1 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.813966 1087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "726143703cb94393823855ee208eebf4"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
mode: GRACEFUL
new_leader_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:34988
I20240501 20:11:44.814165 1087 raft_consensus.cc:595] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Received request to transfer leadership to TS c18acb16190241b19009f0ab9fbb74fa
I20240501 20:11:44.818040 1087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
mode: GRACEFUL
new_leader_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:34988
I20240501 20:11:44.818204 1087 raft_consensus.cc:595] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Received request to transfer leadership to TS c18acb16190241b19009f0ab9fbb74fa
I20240501 20:11:44.819861 1087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1db73de80b83439381a97e9190d71900"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
mode: GRACEFUL
new_leader_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:34988
I20240501 20:11:44.820011 1087 raft_consensus.cc:595] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Received request to transfer leadership to TS c18acb16190241b19009f0ab9fbb74fa
I20240501 20:11:44.826340 1011 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d229eda84478481da33affd131762a02"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
mode: GRACEFUL
new_leader_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:47474
I20240501 20:11:44.826537 1011 raft_consensus.cc:595] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Received request to transfer leadership to TS 2b8d071a68934c57869c1049f5a022c0
I20240501 20:11:44.832315 1160 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
mode: GRACEFUL
new_leader_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:34040
I20240501 20:11:44.832504 1160 raft_consensus.cc:595] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Received request to transfer leadership to TS 2b8d071a68934c57869c1049f5a022c0
I20240501 20:11:44.835022 1160 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
mode: GRACEFUL
new_leader_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:34040
I20240501 20:11:44.835206 1160 raft_consensus.cc:595] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Received request to transfer leadership to TS 2b8d071a68934c57869c1049f5a022c0
I20240501 20:11:44.836978 1011 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
mode: GRACEFUL
new_leader_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:47474
I20240501 20:11:44.837183 1011 raft_consensus.cc:595] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Received request to transfer leadership to TS 6167681550df4e21859170d0e86c1e23
I20240501 20:11:44.924856 1242 consensus_queue.cc:1035] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.929590 1210 consensus_queue.cc:1035] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.932159 1243 raft_consensus.cc:979] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0: : Instructing follower c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:44.932300 1243 raft_consensus.cc:1067] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Signalling peer c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:44.932857 1011 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1db73de80b83439381a97e9190d71900"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:47446
I20240501 20:11:44.933076 1011 raft_consensus.cc:482] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:44.933194 1011 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:44.934926 1011 raft_consensus.cc:504] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.935444 1011 leader_election.cc:288] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 2 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.935843 1087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.935886 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.936049 1087 raft_consensus.cc:3032] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:44.936112 1160 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:44.936182 1087 raft_consensus.cc:729] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:44.936481 1087 consensus_queue.cc:260] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.936874 1087 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:44.938261 1160 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 2.
I20240501 20:11:44.938621 976 leader_election.cc:302] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.938866 1241 raft_consensus.cc:2781] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:44.938944 1087 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 2.
I20240501 20:11:44.938992 1241 raft_consensus.cc:686] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:44.939220 1241 consensus_queue.cc:237] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.940815 910 catalog_manager.cc:5484] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 1 to 2, leader changed from 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2) to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 2 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.952194 1241 consensus_queue.cc:1035] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.955469 1207 consensus_queue.cc:1035] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.963446 1243 consensus_queue.cc:1035] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.966758 1242 consensus_queue.cc:1035] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.972019 1243 raft_consensus.cc:979] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0: : Instructing follower c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:44.972165 1243 raft_consensus.cc:1067] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Signalling peer c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:44.972728 1011 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "726143703cb94393823855ee208eebf4"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:47446
I20240501 20:11:44.972880 1011 raft_consensus.cc:482] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:44.972998 1011 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:44.974745 1011 raft_consensus.cc:504] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.975298 1011 leader_election.cc:288] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 2 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:44.975754 1087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:44.975785 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:44.975955 1087 raft_consensus.cc:3032] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:44.975963 1160 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:44.976095 1087 raft_consensus.cc:729] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:44.976398 1087 consensus_queue.cc:260] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.977234 1087 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:44.978557 1160 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 2.
I20240501 20:11:44.978883 976 leader_election.cc:302] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:44.979125 1241 raft_consensus.cc:2781] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:44.979231 1087 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 2.
I20240501 20:11:44.979274 1241 raft_consensus.cc:686] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:44.979527 1241 consensus_queue.cc:237] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:44.981423 908 catalog_manager.cc:5484] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 1 to 2, leader changed from 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2) to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 2 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:44.987591 1087 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:11:44.989284 1243 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.990478 1207 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.993458 1239 raft_consensus.cc:979] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: : Instructing follower 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:11:44.993607 1239 raft_consensus.cc:1067] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Signalling peer 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:11:44.994401 1085 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d229eda84478481da33affd131762a02"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:34976
I20240501 20:11:44.997334 1241 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:44.997514 1085 raft_consensus.cc:482] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:44.997655 1085 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:44.997794 1210 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.000648 1085 raft_consensus.cc:504] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.002128 1159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:45.002570 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:45.003382 1012 raft_consensus.cc:3032] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:45.003494 1012 raft_consensus.cc:729] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:45.003736 1012 consensus_queue.cc:260] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.004011 1012 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.005465 1085 leader_election.cc:288] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:45.007112 1012 raft_consensus.cc:2454] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 2.
I20240501 20:11:45.007434 1052 leader_election.cc:302] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters: 6167681550df4e21859170d0e86c1e23
I20240501 20:11:45.007752 1210 raft_consensus.cc:2781] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:45.007771 1242 raft_consensus.cc:979] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0: : Instructing follower c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:45.007912 1210 raft_consensus.cc:686] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:45.007974 1242 raft_consensus.cc:1067] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Signalling peer c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:45.008158 1210 consensus_queue.cc:237] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.008533 1012 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:47446
I20240501 20:11:45.008692 1012 raft_consensus.cc:482] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:45.008807 1012 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.010272 908 catalog_manager.cc:5484] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 1 to 2, leader changed from c18acb16190241b19009f0ab9fbb74fa (127.0.100.1) to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 2 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:45.011857 1012 raft_consensus.cc:504] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.012425 1012 leader_election.cc:288] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 2 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:45.013093 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:45.013340 1160 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.013496 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:45.013882 1085 raft_consensus.cc:3032] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:45.013985 1085 raft_consensus.cc:729] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:45.014250 1085 consensus_queue.cc:260] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.014607 1085 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.015909 1160 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 2.
I20240501 20:11:45.016294 976 leader_election.cc:302] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:45.016562 1241 raft_consensus.cc:2781] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:45.016726 1241 raft_consensus.cc:686] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:45.016855 1085 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 2.
I20240501 20:11:45.016945 1241 consensus_queue.cc:237] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.018735 909 catalog_manager.cc:5484] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 1 to 2, leader changed from 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2) to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 2 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:45.047958 1253 consensus_queue.cc:1035] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.050796 1208 raft_consensus.cc:979] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23: : Instructing follower 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:11:45.050989 1208 raft_consensus.cc:1067] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Signalling peer 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:11:45.051797 1086 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:34986
I20240501 20:11:45.052008 1086 raft_consensus.cc:482] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:45.052126 1086 raft_consensus.cc:3037] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.052891 1253 consensus_queue.cc:1035] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.054942 1086 raft_consensus.cc:504] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.055459 1085 raft_consensus.cc:1226] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Rejecting Update request from peer 6167681550df4e21859170d0e86c1e23 for earlier term 1. Current term is 2. Ops: []
I20240501 20:11:45.056219 1253 consensus_queue.cc:1046] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.056492 1253 raft_consensus.cc:3032] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:45.056603 1253 raft_consensus.cc:729] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:45.056730 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:45.056916 1012 raft_consensus.cc:3037] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.056877 1253 consensus_queue.cc:260] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.057130 1086 leader_election.cc:288] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:45.057228 1253 raft_consensus.cc:3037] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.058503 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3e09b6d7b8f4cc1956ff50b14a185f6" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:45.059914 1012 raft_consensus.cc:2454] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 2.
I20240501 20:11:45.060303 1052 leader_election.cc:302] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:45.060552 1245 raft_consensus.cc:2781] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:45.060731 1245 raft_consensus.cc:686] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:45.060979 1245 consensus_queue.cc:237] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.062311 1160 raft_consensus.cc:2454] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 2.
I20240501 20:11:45.063097 909 catalog_manager.cc:5484] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 1 to 2, leader changed from 6167681550df4e21859170d0e86c1e23 (127.0.100.3) to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 2 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:45.148545 1241 consensus_queue.cc:1035] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.152593 1239 consensus_queue.cc:1035] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.187770 1245 consensus_queue.cc:1035] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.191682 1242 consensus_queue.cc:1035] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.195027 1253 consensus_queue.cc:1035] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.197490 1273 raft_consensus.cc:979] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23: : Instructing follower 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:11:45.197643 1273 raft_consensus.cc:1067] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Signalling peer 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:11:45.198350 1085 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:34986
I20240501 20:11:45.198534 1085 raft_consensus.cc:482] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:45.198669 1085 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.199267 1273 consensus_queue.cc:1035] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.201272 1085 raft_consensus.cc:504] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.201648 1086 raft_consensus.cc:1226] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Rejecting Update request from peer 6167681550df4e21859170d0e86c1e23 for earlier term 1. Current term is 2. Ops: []
I20240501 20:11:45.201952 1085 leader_election.cc:288] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:45.202215 1273 consensus_queue.cc:1046] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.202380 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:45.202462 1208 raft_consensus.cc:3032] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:45.202569 1208 raft_consensus.cc:729] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:45.202812 1208 consensus_queue.cc:260] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.203148 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:45.203150 1208 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.203323 1012 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.206157 1012 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 2.
I20240501 20:11:45.206467 1052 leader_election.cc:302] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:45.206698 1242 raft_consensus.cc:2781] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:45.206876 1242 raft_consensus.cc:686] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:45.207123 1242 consensus_queue.cc:237] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.208495 1160 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 2.
I20240501 20:11:45.209710 1239 consensus_queue.cc:1035] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.210606 909 catalog_manager.cc:5484] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 1 to 2, leader changed from 6167681550df4e21859170d0e86c1e23 (127.0.100.3) to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 2 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:45.213778 1207 consensus_queue.cc:1035] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:11:45.216902 1239 raft_consensus.cc:979] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa: : Instructing follower 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:11:45.217073 1239 raft_consensus.cc:1067] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Signalling peer 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:11:45.217684 1160 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:34038
I20240501 20:11:45.217851 1160 raft_consensus.cc:482] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:45.217985 1160 raft_consensus.cc:3037] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.219929 1160 raft_consensus.cc:504] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.220434 1160 leader_election.cc:288] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 2 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:45.220803 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:45.220801 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f74560ac446240e18b69a37e4e6ee7cf" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:45.221093 1012 raft_consensus.cc:3032] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:45.221117 1086 raft_consensus.cc:3037] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.221200 1012 raft_consensus.cc:729] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:45.221491 1012 consensus_queue.cc:260] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.221854 1012 raft_consensus.cc:3037] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.223994 1086 raft_consensus.cc:2454] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 2.
I20240501 20:11:45.224328 1124 leader_election.cc:302] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:45.224412 1012 raft_consensus.cc:2454] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 2.
I20240501 20:11:45.224601 1208 raft_consensus.cc:2781] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:45.224752 1208 raft_consensus.cc:686] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 2 LEADER]: Becoming Leader. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:45.225085 1208 consensus_queue.cc:237] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:45.227564 910 catalog_manager.cc:5484] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 reported cstate change: term changed from 1 to 2, leader changed from c18acb16190241b19009f0ab9fbb74fa (127.0.100.1) to 6167681550df4e21859170d0e86c1e23 (127.0.100.3). New cstate: current_term: 2 leader_uuid: "6167681550df4e21859170d0e86c1e23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:45.363987 1160 raft_consensus.cc:1261] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.364535 1207 consensus_queue.cc:1035] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.367615 1086 raft_consensus.cc:1261] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.368374 1241 consensus_queue.cc:1035] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.425500 1012 raft_consensus.cc:1261] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.426100 1245 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.428721 1160 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:45.432294 1160 raft_consensus.cc:1261] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.432747 1210 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.457564 1160 raft_consensus.cc:1261] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.457960 1207 consensus_queue.cc:1035] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.460309 1086 raft_consensus.cc:1261] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.460842 1239 consensus_queue.cc:1035] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.472173 1160 raft_consensus.cc:1261] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.472601 1210 consensus_queue.cc:1035] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.475260 1012 raft_consensus.cc:1261] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.475740 1210 consensus_queue.cc:1035] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.535651 1086 raft_consensus.cc:1261] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.536358 1239 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.539348 1160 raft_consensus.cc:1261] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.539841 1207 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.721573 1160 raft_consensus.cc:1261] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.722060 1210 consensus_queue.cc:1035] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.725142 1012 raft_consensus.cc:1261] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.725605 1245 consensus_queue.cc:1035] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.777259 1086 raft_consensus.cc:1261] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.777748 1208 consensus_queue.cc:1035] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:45.780726 1012 raft_consensus.cc:1261] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:45.781234 1284 consensus_queue.cc:1035] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:47.847330 400 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240501 20:11:47.847595 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:47.854827 1012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
mode: GRACEFUL
new_leader_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:47478
I20240501 20:11:47.855044 1012 raft_consensus.cc:595] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Received request to transfer leadership to TS 6167681550df4e21859170d0e86c1e23
I20240501 20:11:47.860718 1086 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
mode: GRACEFUL
new_leader_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:35004
I20240501 20:11:47.860904 1086 raft_consensus.cc:595] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Received request to transfer leadership to TS 6167681550df4e21859170d0e86c1e23
I20240501 20:11:47.861356 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 20:11:47.861524 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:47.882609 1245 raft_consensus.cc:979] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0: : Instructing follower 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:11:47.882772 1245 raft_consensus.cc:1067] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Signalling peer 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:11:47.883288 1160 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:34030
I20240501 20:11:47.883456 1160 raft_consensus.cc:482] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:47.883596 1160 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:47.885766 1160 raft_consensus.cc:504] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:47.886309 1160 leader_election.cc:288] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 2 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:47.886729 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:47.886925 1086 raft_consensus.cc:3032] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:11:47.887019 1086 raft_consensus.cc:729] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:47.887256 1086 consensus_queue.cc:260] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:47.887544 1086 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:47.888777 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:47.889006 1012 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:11:47.889806 1086 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 2.
I20240501 20:11:47.890214 1124 leader_election.cc:302] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:47.890497 1208 raft_consensus.cc:2781] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:11:47.890859 1208 raft_consensus.cc:686] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 LEADER]: Becoming Leader. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:47.891148 1208 consensus_queue.cc:237] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:47.891422 1012 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 2.
I20240501 20:11:47.893491 910 catalog_manager.cc:5484] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 reported cstate change: term changed from 1 to 2, leader changed from 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2) to 6167681550df4e21859170d0e86c1e23 (127.0.100.3). New cstate: current_term: 2 leader_uuid: "6167681550df4e21859170d0e86c1e23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:47.991690 1239 raft_consensus.cc:979] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa: : Instructing follower 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:11:47.991876 1239 raft_consensus.cc:1067] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Signalling peer 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:11:47.992410 1160 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:34038
I20240501 20:11:47.992623 1160 raft_consensus.cc:482] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:47.992719 1160 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:47.994753 1160 raft_consensus.cc:504] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:47.995319 1160 leader_election.cc:288] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 3 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:11:47.995652 1012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:11:47.995862 1012 raft_consensus.cc:3032] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:47.995810 1086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:47.995962 1012 raft_consensus.cc:729] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:47.996006 1086 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:47.996209 1012 consensus_queue.cc:260] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:47.996503 1012 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:47.998010 1086 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 3.
I20240501 20:11:47.998356 1124 leader_election.cc:302] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:11:47.998520 1012 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 3.
I20240501 20:11:47.998651 1208 raft_consensus.cc:2781] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:47.998802 1208 raft_consensus.cc:686] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 LEADER]: Becoming Leader. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:47.999044 1208 consensus_queue.cc:237] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:48.001338 910 catalog_manager.cc:5484] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 reported cstate change: term changed from 2 to 3, leader changed from c18acb16190241b19009f0ab9fbb74fa (127.0.100.1) to 6167681550df4e21859170d0e86c1e23 (127.0.100.3). New cstate: current_term: 3 leader_uuid: "6167681550df4e21859170d0e86c1e23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: HEALTHY } } }
I20240501 20:11:48.332037 1086 raft_consensus.cc:1261] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:48.332610 1208 consensus_queue.cc:1035] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:48.336324 1012 raft_consensus.cc:1261] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:11:48.336894 1208 consensus_queue.cc:1035] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:11:48.450333 1011 raft_consensus.cc:1261] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:48.450856 1299 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:48.453817 1086 raft_consensus.cc:1261] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:48.454406 1289 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:48.861860 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:48.863466 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:48.863660 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:49.864044 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:49.865741 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:49.865923 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:50.866272 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:50.868499 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:50.868695 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:51.869004 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:51.870734 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:51.870903 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:52.871239 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:52.873026 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:52.873255 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:53.873593 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:53.875265 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:53.875437 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:54.875794 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:54.877473 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:54.877683 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:55.878021 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:55.879810 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:55.879979 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:56.880373 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:11:56.882172 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:11:56.882359 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:11:57.892464 400 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240501 20:11:57.896724 1160 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
mode: GRACEFUL
new_leader_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:34040
I20240501 20:11:57.896929 1160 raft_consensus.cc:595] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 LEADER]: Received request to transfer leadership to TS c18acb16190241b19009f0ab9fbb74fa
I20240501 20:11:57.899514 1085 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d229eda84478481da33affd131762a02"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
mode: GRACEFUL
new_leader_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:34988
I20240501 20:11:57.899703 1085 raft_consensus.cc:595] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Received request to transfer leadership to TS c18acb16190241b19009f0ab9fbb74fa
I20240501 20:11:57.901844 1085 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
mode: GRACEFUL
new_leader_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:34988
I20240501 20:11:57.902019 1085 raft_consensus.cc:595] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Received request to transfer leadership to TS c18acb16190241b19009f0ab9fbb74fa
I20240501 20:11:57.903792 1160 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
mode: GRACEFUL
new_leader_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:34040
I20240501 20:11:57.903939 1160 raft_consensus.cc:595] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 LEADER]: Received request to transfer leadership to TS c18acb16190241b19009f0ab9fbb74fa
I20240501 20:11:57.917222 1310 raft_consensus.cc:979] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23: : Instructing follower c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:57.917351 1310 raft_consensus.cc:1067] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 LEADER]: Signalling peer c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:57.917855 1011 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:47458
I20240501 20:11:57.918004 1011 raft_consensus.cc:482] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:57.918097 1011 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:57.919857 1011 raft_consensus.cc:504] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:57.920397 1011 leader_election.cc:288] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 3 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:57.920713 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:57.920887 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7b620c1a0b048c290ce30499fc63735" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:57.920960 1085 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:57.921066 1160 raft_consensus.cc:3032] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:57.921180 1160 raft_consensus.cc:729] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:57.921430 1160 consensus_queue.cc:260] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:57.921808 1160 raft_consensus.cc:3037] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:57.923748 1085 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 3.
I20240501 20:11:57.924139 975 leader_election.cc:302] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:57.924331 1160 raft_consensus.cc:2454] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 3.
I20240501 20:11:57.924422 1306 raft_consensus.cc:2781] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:57.924827 1306 raft_consensus.cc:686] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:57.925153 1306 consensus_queue.cc:237] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:57.927160 910 catalog_manager.cc:5484] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 2 to 3, leader changed from 6167681550df4e21859170d0e86c1e23 (127.0.100.3) to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 3 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:58.006482 1317 raft_consensus.cc:979] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0: : Instructing follower c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:58.006647 1317 raft_consensus.cc:1067] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Signalling peer c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:58.007244 1011 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d229eda84478481da33affd131762a02"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:47446
I20240501 20:11:58.007426 1011 raft_consensus.cc:482] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:58.007529 1011 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:58.009408 1011 raft_consensus.cc:504] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.009932 1011 leader_election.cc:288] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 3 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:58.010345 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:58.010365 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:58.010516 1160 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:58.010568 1085 raft_consensus.cc:3032] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:58.010663 1085 raft_consensus.cc:729] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:58.010895 1085 consensus_queue.cc:260] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.011193 1085 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:58.012439 1160 raft_consensus.cc:2454] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 3.
I20240501 20:11:58.012820 976 leader_election.cc:302] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:58.013124 1306 raft_consensus.cc:2781] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:58.013278 1306 raft_consensus.cc:686] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:58.013535 1306 consensus_queue.cc:237] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.013837 1085 raft_consensus.cc:2454] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 3.
I20240501 20:11:58.016016 910 catalog_manager.cc:5484] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 2 to 3, leader changed from 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2) to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 3 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:58.093118 1307 raft_consensus.cc:979] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0: : Instructing follower c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:58.093297 1307 raft_consensus.cc:1067] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Signalling peer c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:58.093935 1011 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:47446
I20240501 20:11:58.094115 1011 raft_consensus.cc:482] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:58.094274 1011 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:58.096176 1011 raft_consensus.cc:504] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.096738 1011 leader_election.cc:288] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 3 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:58.097190 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:58.097186 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3f76db3827a45c585b51abf909c5247" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:58.097395 1160 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:58.097397 1085 raft_consensus.cc:3032] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:11:58.097514 1085 raft_consensus.cc:729] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:11:58.097738 1085 consensus_queue.cc:260] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.098042 1085 raft_consensus.cc:3037] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:11:58.099371 1160 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 3.
I20240501 20:11:58.099674 976 leader_election.cc:302] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6167681550df4e21859170d0e86c1e23, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:58.099953 1306 raft_consensus.cc:2781] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:11:58.100060 1085 raft_consensus.cc:2454] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 3.
I20240501 20:11:58.100127 1306 raft_consensus.cc:686] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:58.100374 1306 consensus_queue.cc:237] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.102638 910 catalog_manager.cc:5484] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 2 to 3, leader changed from 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2) to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 3 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:58.227421 1299 raft_consensus.cc:979] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23: : Instructing follower c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:58.227618 1299 raft_consensus.cc:1067] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 LEADER]: Signalling peer c18acb16190241b19009f0ab9fbb74fa to start an election
I20240501 20:11:58.228185 1011 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
from {username='slave'} at 127.0.0.1:47458
I20240501 20:11:58.228364 1011 raft_consensus.cc:482] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:11:58.228446 1011 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:58.230751 1011 raft_consensus.cc:504] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.231312 1011 leader_election.cc:288] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 4 election: Requested vote from peers 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:11:58.231757 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:11:58.231714 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a04dac2b2d342e3b66ae400f459534f" candidate_uuid: "c18acb16190241b19009f0ab9fbb74fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:11:58.231923 1160 raft_consensus.cc:3032] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 20:11:58.231961 1085 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:58.232045 1160 raft_consensus.cc:729] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:11:58.232308 1160 consensus_queue.cc:260] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.232705 1160 raft_consensus.cc:3037] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:11:58.234838 1085 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 4.
I20240501 20:11:58.235222 975 leader_election.cc:302] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, c18acb16190241b19009f0ab9fbb74fa; no voters:
I20240501 20:11:58.235255 1160 raft_consensus.cc:2454] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c18acb16190241b19009f0ab9fbb74fa in term 4.
I20240501 20:11:58.235507 1306 raft_consensus.cc:2781] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 4 FOLLOWER]: Leader election won for term 4
I20240501 20:11:58.235664 1306 raft_consensus.cc:686] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 4 LEADER]: Becoming Leader. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:11:58.235886 1306 consensus_queue.cc:237] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:11:58.238107 910 catalog_manager.cc:5484] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa reported cstate change: term changed from 3 to 4, leader changed from 6167681550df4e21859170d0e86c1e23 (127.0.100.3) to c18acb16190241b19009f0ab9fbb74fa (127.0.100.1). New cstate: current_term: 4 leader_uuid: "c18acb16190241b19009f0ab9fbb74fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:11:58.450472 1085 raft_consensus.cc:1261] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:58.450989 1306 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:58.454798 1160 raft_consensus.cc:1261] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:58.455648 1311 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:58.510663 1085 raft_consensus.cc:1261] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:58.511245 1323 consensus_queue.cc:1035] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:58.515089 1160 raft_consensus.cc:1261] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:58.515540 1311 consensus_queue.cc:1035] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:58.526969 1085 raft_consensus.cc:1261] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:58.527417 1311 consensus_queue.cc:1035] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:58.530167 1160 raft_consensus.cc:1261] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:11:58.530663 1311 consensus_queue.cc:1035] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:11:58.614224 1160 raft_consensus.cc:1261] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 4 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:58.614735 1311 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:11:58.617682 1085 raft_consensus.cc:1261] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Refusing update from remote peer c18acb16190241b19009f0ab9fbb74fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:11:58.618598 1323 consensus_queue.cc:1035] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:00.915745 400 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240501 20:12:00.916003 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:00.918164 1011 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1db73de80b83439381a97e9190d71900"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
mode: GRACEFUL
new_leader_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:47478
I20240501 20:12:00.918351 1011 raft_consensus.cc:595] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Received request to transfer leadership to TS 6167681550df4e21859170d0e86c1e23
I20240501 20:12:00.919204 1011 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "726143703cb94393823855ee208eebf4"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
mode: GRACEFUL
new_leader_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:47478
I20240501 20:12:00.919361 1011 raft_consensus.cc:595] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Received request to transfer leadership to TS 2b8d071a68934c57869c1049f5a022c0
I20240501 20:12:00.920135 1011 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
mode: GRACEFUL
new_leader_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:47478
I20240501 20:12:00.920269 1011 raft_consensus.cc:595] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Received request to transfer leadership to TS 2b8d071a68934c57869c1049f5a022c0
I20240501 20:12:00.921003 1011 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d229eda84478481da33affd131762a02"
dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
mode: GRACEFUL
new_leader_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:47478
I20240501 20:12:00.921147 1011 raft_consensus.cc:595] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Received request to transfer leadership to TS 6167681550df4e21859170d0e86c1e23
I20240501 20:12:00.921489 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240501 20:12:00.921676 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:01.041119 1306 raft_consensus.cc:979] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: : Instructing follower 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:12:01.041342 1333 raft_consensus.cc:1067] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Signalling peer 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:12:01.042022 1160 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d229eda84478481da33affd131762a02"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:34038
I20240501 20:12:01.042196 1160 raft_consensus.cc:482] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:12:01.042326 1160 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:12:01.044306 1160 raft_consensus.cc:504] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.044996 1160 leader_election.cc:288] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 4 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:12:01.045462 1011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:12:01.045533 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d229eda84478481da33affd131762a02" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:12:01.045624 1011 raft_consensus.cc:3032] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Stepping down as leader of term 3
I20240501 20:12:01.045729 1011 raft_consensus.cc:729] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:12:01.045756 1085 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:12:01.045979 1011 consensus_queue.cc:260] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.046366 1011 raft_consensus.cc:3037] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Advancing to term 4
I20240501 20:12:01.047739 1085 raft_consensus.cc:2454] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 4.
I20240501 20:12:01.048097 1124 leader_election.cc:302] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:12:01.048338 1299 raft_consensus.cc:2781] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 20:12:01.048424 1011 raft_consensus.cc:2454] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 4.
I20240501 20:12:01.048748 1299 raft_consensus.cc:686] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 4 LEADER]: Becoming Leader. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:12:01.049016 1299 consensus_queue.cc:237] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.051189 910 catalog_manager.cc:5484] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 reported cstate change: term changed from 3 to 4, leader changed from c18acb16190241b19009f0ab9fbb74fa (127.0.100.1) to 6167681550df4e21859170d0e86c1e23 (127.0.100.3). New cstate: current_term: 4 leader_uuid: "6167681550df4e21859170d0e86c1e23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:01.229455 1306 raft_consensus.cc:979] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa: : Instructing follower 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:12:01.229637 1306 raft_consensus.cc:1067] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Signalling peer 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:12:01.230180 1085 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "726143703cb94393823855ee208eebf4"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:34976
I20240501 20:12:01.230358 1085 raft_consensus.cc:482] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:12:01.230455 1085 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:12:01.232420 1085 raft_consensus.cc:504] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.233105 1085 leader_election.cc:288] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 3 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:12:01.233465 1011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:12:01.233461 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726143703cb94393823855ee208eebf4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:12:01.233687 1011 raft_consensus.cc:3032] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:12:01.233728 1160 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:12:01.233785 1011 raft_consensus.cc:729] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:12:01.234004 1011 consensus_queue.cc:260] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.234301 1011 raft_consensus.cc:3037] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:12:01.235700 1160 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 3.
I20240501 20:12:01.236057 1051 leader_election.cc:302] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:12:01.236199 1011 raft_consensus.cc:2454] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 3.
I20240501 20:12:01.236317 1307 raft_consensus.cc:2781] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:12:01.236696 1307 raft_consensus.cc:686] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 3 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:12:01.236959 1307 consensus_queue.cc:237] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.239190 910 catalog_manager.cc:5484] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 2 to 3, leader changed from c18acb16190241b19009f0ab9fbb74fa (127.0.100.1) to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 3 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:01.310709 1333 raft_consensus.cc:979] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa: : Instructing follower 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:12:01.310926 1333 raft_consensus.cc:1067] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Signalling peer 6167681550df4e21859170d0e86c1e23 to start an election
I20240501 20:12:01.311473 1160 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1db73de80b83439381a97e9190d71900"
dest_uuid: "6167681550df4e21859170d0e86c1e23"
from {username='slave'} at 127.0.0.1:34038
I20240501 20:12:01.311653 1160 raft_consensus.cc:482] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:12:01.311774 1160 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:12:01.313611 1160 raft_consensus.cc:504] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.314257 1160 leader_election.cc:288] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 3 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2:43231)
I20240501 20:12:01.314508 1011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:12:01.314633 1085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1db73de80b83439381a97e9190d71900" candidate_uuid: "6167681550df4e21859170d0e86c1e23" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
I20240501 20:12:01.314714 1011 raft_consensus.cc:3032] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Stepping down as leader of term 2
I20240501 20:12:01.314805 1085 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:12:01.314860 1011 raft_consensus.cc:729] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:12:01.315148 1011 consensus_queue.cc:260] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.315449 1011 raft_consensus.cc:3037] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Advancing to term 3
I20240501 20:12:01.316953 1085 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 3.
I20240501 20:12:01.317322 1124 leader_election.cc:302] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:12:01.317593 1299 raft_consensus.cc:2781] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 20:12:01.317631 1011 raft_consensus.cc:2454] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6167681550df4e21859170d0e86c1e23 in term 3.
I20240501 20:12:01.318569 1299 raft_consensus.cc:686] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 3 LEADER]: Becoming Leader. State: Replica: 6167681550df4e21859170d0e86c1e23, State: Running, Role: LEADER
I20240501 20:12:01.318840 1299 consensus_queue.cc:237] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.321269 910 catalog_manager.cc:5484] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 reported cstate change: term changed from 2 to 3, leader changed from c18acb16190241b19009f0ab9fbb74fa (127.0.100.1) to 6167681550df4e21859170d0e86c1e23 (127.0.100.3). New cstate: current_term: 3 leader_uuid: "6167681550df4e21859170d0e86c1e23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:01.395900 1306 raft_consensus.cc:979] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa: : Instructing follower 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:12:01.396065 1306 raft_consensus.cc:1067] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Signalling peer 2b8d071a68934c57869c1049f5a022c0 to start an election
I20240501 20:12:01.396636 1086 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4"
dest_uuid: "2b8d071a68934c57869c1049f5a022c0"
from {username='slave'} at 127.0.0.1:34976
I20240501 20:12:01.396836 1086 raft_consensus.cc:482] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 20:12:01.397392 1086 raft_consensus.cc:3037] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:12:01.399205 1086 raft_consensus.cc:504] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.399721 1086 leader_election.cc:288] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Requested vote from peers c18acb16190241b19009f0ab9fbb74fa (127.0.100.1:41299), 6167681550df4e21859170d0e86c1e23 (127.0.100.3:40033)
I20240501 20:12:01.400092 1011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c18acb16190241b19009f0ab9fbb74fa"
I20240501 20:12:01.400151 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810427b61b284ec2a4d4a44af6a00bd4" candidate_uuid: "2b8d071a68934c57869c1049f5a022c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6167681550df4e21859170d0e86c1e23"
I20240501 20:12:01.400255 1011 raft_consensus.cc:3032] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Stepping down as leader of term 1
I20240501 20:12:01.400369 1011 raft_consensus.cc:729] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c18acb16190241b19009f0ab9fbb74fa, State: Running, Role: LEADER
I20240501 20:12:01.400405 1160 raft_consensus.cc:3037] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:12:01.400615 1011 consensus_queue.cc:260] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.400907 1011 raft_consensus.cc:3037] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Advancing to term 2
I20240501 20:12:01.402405 1160 raft_consensus.cc:2454] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 2.
I20240501 20:12:01.402693 1011 raft_consensus.cc:2454] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b8d071a68934c57869c1049f5a022c0 in term 2.
I20240501 20:12:01.402781 1051 leader_election.cc:302] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d071a68934c57869c1049f5a022c0, 6167681550df4e21859170d0e86c1e23; no voters:
I20240501 20:12:01.403044 1307 raft_consensus.cc:2781] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 20:12:01.403175 1307 raft_consensus.cc:686] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Becoming Leader. State: Replica: 2b8d071a68934c57869c1049f5a022c0, State: Running, Role: LEADER
I20240501 20:12:01.403412 1307 consensus_queue.cc:237] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } }
I20240501 20:12:01.405738 910 catalog_manager.cc:5484] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 reported cstate change: term changed from 1 to 2, leader changed from c18acb16190241b19009f0ab9fbb74fa (127.0.100.1) to 2b8d071a68934c57869c1049f5a022c0 (127.0.100.2). New cstate: current_term: 2 leader_uuid: "2b8d071a68934c57869c1049f5a022c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:01.532668 1086 raft_consensus.cc:1261] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:12:01.533201 1299 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:01.538272 1011 raft_consensus.cc:1261] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 4 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 20:12:01.538754 1342 consensus_queue.cc:1035] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:01.661739 1160 raft_consensus.cc:1261] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:12:01.662293 1307 consensus_queue.cc:1035] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:01.666152 1011 raft_consensus.cc:1261] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:12:01.666595 1307 consensus_queue.cc:1035] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:01.777120 1011 raft_consensus.cc:1261] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:12:01.777688 1342 consensus_queue.cc:1035] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:01.781466 1086 raft_consensus.cc:1261] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Refusing update from remote peer 6167681550df4e21859170d0e86c1e23: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 20:12:01.781919 1334 consensus_queue.cc:1035] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d071a68934c57869c1049f5a022c0" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 43231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:01.814695 1160 raft_consensus.cc:1261] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:12:01.815227 1307 consensus_queue.cc:1035] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6167681550df4e21859170d0e86c1e23" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:01.819211 1011 raft_consensus.cc:1261] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Refusing update from remote peer 2b8d071a68934c57869c1049f5a022c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 20:12:01.819883 1307 consensus_queue.cc:1035] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c18acb16190241b19009f0ab9fbb74fa" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:01.922009 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:01.923627 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:01.923851 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:02.924190 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:02.925863 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:02.926015 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:03.926395 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:03.928009 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:03.928179 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:04.928483 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:04.930112 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:04.930259 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:05.930670 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:05.933687 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:05.933903 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:06.934257 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:06.935961 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:06.936143 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:07.936501 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:07.938151 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:07.938352 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:08.938683 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:08.940815 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:08.940990 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:09.941382 400 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 20:12:09.943109 400 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 20:12:09.943324 400 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 20:12:10.953768 400 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240501 20:12:10.953966 400 tablet_server.cc:178] TabletServer@127.0.100.1:0 shutting down...
I20240501 20:12:10.961632 400 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 20:12:10.961894 400 tablet_replica.cc:330] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.962088 400 raft_consensus.cc:2229] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.962277 400 raft_consensus.cc:2258] T 726143703cb94393823855ee208eebf4 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.962808 400 tablet_replica.cc:330] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.962965 400 raft_consensus.cc:2229] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Raft consensus shutting down.
I20240501 20:12:10.963214 400 raft_consensus.cc:2258] T d3f76db3827a45c585b51abf909c5247 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.963657 400 tablet_replica.cc:330] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.963786 400 raft_consensus.cc:2229] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.963924 400 raft_consensus.cc:2258] T d229eda84478481da33affd131762a02 P c18acb16190241b19009f0ab9fbb74fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.964308 400 tablet_replica.cc:330] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.964447 400 raft_consensus.cc:2229] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.964576 400 raft_consensus.cc:2258] T f74560ac446240e18b69a37e4e6ee7cf P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.964980 400 tablet_replica.cc:330] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.965126 400 raft_consensus.cc:2229] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 1 LEADER]: Raft consensus shutting down.
I20240501 20:12:10.965353 400 raft_consensus.cc:2258] T adae83c692fd4436881365daa06ef546 P c18acb16190241b19009f0ab9fbb74fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.965735 400 tablet_replica.cc:330] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.965868 400 raft_consensus.cc:2229] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 3 LEADER]: Raft consensus shutting down.
I20240501 20:12:10.966078 400 raft_consensus.cc:2258] T e7b620c1a0b048c290ce30499fc63735 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.966470 400 tablet_replica.cc:330] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.966599 400 raft_consensus.cc:2229] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 4 LEADER]: Raft consensus shutting down.
I20240501 20:12:10.966801 400 raft_consensus.cc:2258] T 7a04dac2b2d342e3b66ae400f459534f P c18acb16190241b19009f0ab9fbb74fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.967139 400 tablet_replica.cc:330] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.967255 400 raft_consensus.cc:2229] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.967361 400 raft_consensus.cc:2258] T d3e09b6d7b8f4cc1956ff50b14a185f6 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.967751 400 tablet_replica.cc:330] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.967852 400 raft_consensus.cc:2229] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.967970 400 raft_consensus.cc:2258] T 810427b61b284ec2a4d4a44af6a00bd4 P c18acb16190241b19009f0ab9fbb74fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.968297 400 tablet_replica.cc:330] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa: stopping tablet replica
I20240501 20:12:10.968405 400 raft_consensus.cc:2229] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.968509 400 raft_consensus.cc:2258] T 1db73de80b83439381a97e9190d71900 P c18acb16190241b19009f0ab9fbb74fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.983564 400 tablet_server.cc:194] TabletServer@127.0.100.1:0 shutdown complete.
I20240501 20:12:10.987368 400 tablet_server.cc:178] TabletServer@127.0.100.2:0 shutting down...
I20240501 20:12:10.994966 400 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 20:12:10.995158 400 tablet_replica.cc:330] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.995312 400 raft_consensus.cc:2229] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.995471 400 raft_consensus.cc:2258] T e7b620c1a0b048c290ce30499fc63735 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.995987 400 tablet_replica.cc:330] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.996116 400 raft_consensus.cc:2229] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 3 LEADER]: Raft consensus shutting down.
I20240501 20:12:10.996337 400 raft_consensus.cc:2258] T 726143703cb94393823855ee208eebf4 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.996753 400 tablet_replica.cc:330] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.996873 400 raft_consensus.cc:2229] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.996989 400 raft_consensus.cc:2258] T f74560ac446240e18b69a37e4e6ee7cf P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.997372 400 tablet_replica.cc:330] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.997491 400 raft_consensus.cc:2229] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.997602 400 raft_consensus.cc:2258] T adae83c692fd4436881365daa06ef546 P 2b8d071a68934c57869c1049f5a022c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.997957 400 tablet_replica.cc:330] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.998070 400 raft_consensus.cc:2229] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Raft consensus shutting down.
I20240501 20:12:10.998267 400 raft_consensus.cc:2258] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.998622 400 tablet_replica.cc:330] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.998728 400 raft_consensus.cc:2229] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 LEADER]: Raft consensus shutting down.
I20240501 20:12:10.998934 400 raft_consensus.cc:2258] T 810427b61b284ec2a4d4a44af6a00bd4 P 2b8d071a68934c57869c1049f5a022c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.999285 400 tablet_replica.cc:330] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.999392 400 raft_consensus.cc:2229] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:10.999509 400 raft_consensus.cc:2258] T 1db73de80b83439381a97e9190d71900 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:10.999861 400 tablet_replica.cc:330] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:10.999965 400 raft_consensus.cc:2229] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.000074 400 raft_consensus.cc:2258] T d229eda84478481da33affd131762a02 P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.000560 400 tablet_replica.cc:330] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:11.000741 400 raft_consensus.cc:2229] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.000867 400 raft_consensus.cc:2258] T d3f76db3827a45c585b51abf909c5247 P 2b8d071a68934c57869c1049f5a022c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.001278 400 tablet_replica.cc:330] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0: stopping tablet replica
I20240501 20:12:11.001364 400 raft_consensus.cc:2229] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.001482 400 raft_consensus.cc:2258] T 7a04dac2b2d342e3b66ae400f459534f P 2b8d071a68934c57869c1049f5a022c0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.016037 400 tablet_server.cc:194] TabletServer@127.0.100.2:0 shutdown complete.
I20240501 20:12:11.019812 400 tablet_server.cc:178] TabletServer@127.0.100.3:0 shutting down...
I20240501 20:12:11.027331 400 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 20:12:11.027554 400 tablet_replica.cc:330] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.027717 400 raft_consensus.cc:2229] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.027866 400 raft_consensus.cc:2258] T e7b620c1a0b048c290ce30499fc63735 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.028311 400 tablet_replica.cc:330] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.028434 400 raft_consensus.cc:2229] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.028558 400 raft_consensus.cc:2258] T d3f76db3827a45c585b51abf909c5247 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.029217 400 tablet_replica.cc:330] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.029341 400 raft_consensus.cc:2229] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 4 LEADER]: Raft consensus shutting down.
I20240501 20:12:11.029580 400 raft_consensus.cc:2258] T d229eda84478481da33affd131762a02 P 6167681550df4e21859170d0e86c1e23 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.029963 400 tablet_replica.cc:330] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.030077 400 raft_consensus.cc:2229] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 2 LEADER]: Raft consensus shutting down.
I20240501 20:12:11.030278 400 raft_consensus.cc:2258] T f74560ac446240e18b69a37e4e6ee7cf P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.030649 400 tablet_replica.cc:330] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.030756 400 raft_consensus.cc:2229] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.030864 400 raft_consensus.cc:2258] T adae83c692fd4436881365daa06ef546 P 6167681550df4e21859170d0e86c1e23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.031205 400 tablet_replica.cc:330] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.031314 400 raft_consensus.cc:2229] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.031430 400 raft_consensus.cc:2258] T 7a04dac2b2d342e3b66ae400f459534f P 6167681550df4e21859170d0e86c1e23 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.031780 400 tablet_replica.cc:330] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.031884 400 raft_consensus.cc:2229] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.032006 400 raft_consensus.cc:2258] T 726143703cb94393823855ee208eebf4 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.032351 400 tablet_replica.cc:330] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.032456 400 raft_consensus.cc:2229] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 3 LEADER]: Raft consensus shutting down.
I20240501 20:12:11.032663 400 raft_consensus.cc:2258] T 1db73de80b83439381a97e9190d71900 P 6167681550df4e21859170d0e86c1e23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.033020 400 tablet_replica.cc:330] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.033135 400 raft_consensus.cc:2229] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.033232 400 raft_consensus.cc:2258] T 810427b61b284ec2a4d4a44af6a00bd4 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.033542 400 tablet_replica.cc:330] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23: stopping tablet replica
I20240501 20:12:11.033628 400 raft_consensus.cc:2229] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:11.037127 400 raft_consensus.cc:2258] T d3e09b6d7b8f4cc1956ff50b14a185f6 P 6167681550df4e21859170d0e86c1e23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.051371 400 tablet_server.cc:194] TabletServer@127.0.100.3:0 shutdown complete.
I20240501 20:12:11.055274 400 master.cc:537] Master@127.0.100.62:40681 shutting down...
I20240501 20:12:11.061928 400 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 1 LEADER]: Raft consensus shutting down.
I20240501 20:12:11.062091 400 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:11.062176 400 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5cfa93c716294841a311114736d62502: stopping tablet replica
I20240501 20:12:11.074723 400 master.cc:552] Master@127.0.100.62:40681 shutdown complete.
2b8d071a68934c57869c1049f5a022c0 4
6167681550df4e21859170d0e86c1e23 1
c18acb16190241b19009f0ab9fbb74fa 5
2b8d071a68934c57869c1049f5a022c0 3
6167681550df4e21859170d0e86c1e23 3
c18acb16190241b19009f0ab9fbb74fa 4
2b8d071a68934c57869c1049f5a022c0 1
6167681550df4e21859170d0e86c1e23 1
c18acb16190241b19009f0ab9fbb74fa 8
2b8d071a68934c57869c1049f5a022c0 3
6167681550df4e21859170d0e86c1e23 3
c18acb16190241b19009f0ab9fbb74fa 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27162 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240501 20:12:11.088729 400 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.100.62:37747
I20240501 20:12:11.089324 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:12:11.092130 1365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:11.092784 1366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:12:11.093326 400 server_base.cc:1034] running on GCE node
W20240501 20:12:11.094197 1368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:12:11.094498 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:12:11.094568 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:12:11.094599 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594331094595 us; error 0 us; skew 500 ppm
I20240501 20:12:11.094732 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:12:11.100276 400 webserver.cc:460] Webserver started at http://127.0.100.62:35821/ using document root <none> and password file <none>
I20240501 20:12:11.100478 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:12:11.100543 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:12:11.100656 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:12:11.101263 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/master-0-root/instance:
uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.103863 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:12:11.105218 1373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.105544 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240501 20:12:11.105626 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/master-0-root
uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.105707 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:12:11.141847 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:12:11.142334 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:12:11.155385 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.62:37747
I20240501 20:12:11.155455 1424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.62:37747 every 8 connection(s)
I20240501 20:12:11.156626 1425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.160392 1425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1: Bootstrap starting.
I20240501 20:12:11.161557 1425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.162899 1425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1: No bootstrap required, opened a new log
I20240501 20:12:11.163376 1425 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" member_type: VOTER }
I20240501 20:12:11.163486 1425 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.163533 1425 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad1816cf3544bdf815c1f8e3db4c7b1, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.163714 1425 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" member_type: VOTER }
I20240501 20:12:11.163827 1425 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 20:12:11.163894 1425 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 20:12:11.163964 1425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:11.165603 1425 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" member_type: VOTER }
I20240501 20:12:11.165764 1425 leader_election.cc:302] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ad1816cf3544bdf815c1f8e3db4c7b1; no voters:
I20240501 20:12:11.166075 1425 leader_election.cc:288] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 20:12:11.166164 1428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:11.166529 1428 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [term 1 LEADER]: Becoming Leader. State: Replica: 7ad1816cf3544bdf815c1f8e3db4c7b1, State: Running, Role: LEADER
I20240501 20:12:11.166746 1428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" member_type: VOTER }
I20240501 20:12:11.166800 1425 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 20:12:11.167374 1429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" member_type: VOTER } }
I20240501 20:12:11.167439 1430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ad1816cf3544bdf815c1f8e3db4c7b1. Latest consensus state: current_term: 1 leader_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad1816cf3544bdf815c1f8e3db4c7b1" member_type: VOTER } }
I20240501 20:12:11.167546 1429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [sys.catalog]: This master's current role is: LEADER
I20240501 20:12:11.167595 1430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1 [sys.catalog]: This master's current role is: LEADER
I20240501 20:12:11.168040 1433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 20:12:11.169569 1433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 20:12:11.171371 400 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 20:12:11.172291 1433 catalog_manager.cc:1347] Generated new cluster ID: 8328d5c58ea740f8a3717a195daa2f19
I20240501 20:12:11.172364 1433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 20:12:11.187093 1433 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 20:12:11.187776 1433 catalog_manager.cc:1504] Loading token signing keys...
I20240501 20:12:11.200426 1433 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 7ad1816cf3544bdf815c1f8e3db4c7b1: Generated new TSK 0
I20240501 20:12:11.200608 1433 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 20:12:11.204195 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:12:11.207803 1446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:11.208709 1447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:12:11.210520 400 server_base.cc:1034] running on GCE node
W20240501 20:12:11.211246 1449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:12:11.211577 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:12:11.211640 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:12:11.211663 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594331211659 us; error 0 us; skew 500 ppm
I20240501 20:12:11.211778 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:12:11.212967 400 webserver.cc:460] Webserver started at http://127.0.100.1:42841/ using document root <none> and password file <none>
I20240501 20:12:11.213198 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:12:11.213253 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:12:11.213363 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:12:11.213948 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root/instance:
uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.216243 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240501 20:12:11.217641 1454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.217941 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:11.218022 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root
uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.218124 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:12:11.236495 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:12:11.236984 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:12:11.237525 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:12:11.238318 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:12:11.238368 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.238427 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:12:11.238469 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.251600 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.1:44831
I20240501 20:12:11.251618 1516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.1:44831 every 8 connection(s)
I20240501 20:12:11.253069 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:12:11.256724 1521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:11.257594 1522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:11.258199 1524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:12:11.258780 400 server_base.cc:1034] running on GCE node
I20240501 20:12:11.259020 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:12:11.259084 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:12:11.259114 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594331259110 us; error 0 us; skew 500 ppm
I20240501 20:12:11.259258 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:12:11.259613 1517 heartbeater.cc:347] Connected to a master server at 127.0.100.62:37747
I20240501 20:12:11.259722 1517 heartbeater.cc:464] Registering TS with master...
I20240501 20:12:11.260025 1517 heartbeater.cc:511] Master 127.0.100.62:37747 requested a full tablet report, sending...
I20240501 20:12:11.260813 1390 ts_manager.cc:194] Registered new tserver with Master: d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831)
I20240501 20:12:11.261013 400 webserver.cc:460] Webserver started at http://127.0.100.2:43293/ using document root <none> and password file <none>
I20240501 20:12:11.261216 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:12:11.261278 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:12:11.261384 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:12:11.261857 1390 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48432
I20240501 20:12:11.261909 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root/instance:
uuid: "ea4dd09ef4f040618fc481ba902e8726"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.264114 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:12:11.265498 1529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.265794 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 20:12:11.265900 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root
uuid: "ea4dd09ef4f040618fc481ba902e8726"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.266005 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:12:11.281658 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:12:11.282125 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:12:11.282589 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:12:11.283329 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:12:11.283382 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.283445 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:12:11.283476 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.294708 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.2:35033
I20240501 20:12:11.294729 1591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.2:35033 every 8 connection(s)
I20240501 20:12:11.296092 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:12:11.299355 1595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:11.300200 1596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:11.300830 1598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:12:11.301303 400 server_base.cc:1034] running on GCE node
I20240501 20:12:11.301573 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:12:11.301642 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:12:11.301672 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594331301668 us; error 0 us; skew 500 ppm
I20240501 20:12:11.301813 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:12:11.302373 1592 heartbeater.cc:347] Connected to a master server at 127.0.100.62:37747
I20240501 20:12:11.302496 1592 heartbeater.cc:464] Registering TS with master...
I20240501 20:12:11.302822 1592 heartbeater.cc:511] Master 127.0.100.62:37747 requested a full tablet report, sending...
I20240501 20:12:11.303185 400 webserver.cc:460] Webserver started at http://127.0.100.3:41523/ using document root <none> and password file <none>
I20240501 20:12:11.303403 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:12:11.303464 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:12:11.303558 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:12:11.303659 1390 ts_manager.cc:194] Registered new tserver with Master: ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:11.304133 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root/instance:
uuid: "e3b9f2e003064a248d8822d0ea062b6b"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.304378 1390 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48444
I20240501 20:12:11.306358 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:12:11.307648 1603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.307930 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 20:12:11.308017 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root
uuid: "e3b9f2e003064a248d8822d0ea062b6b"
format_stamp: "Formatted at 2024-05-01 20:12:11 on dist-test-slave-hhxv"
I20240501 20:12:11.308102 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:12:11.335680 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:12:11.336167 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:12:11.336675 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:12:11.337405 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:12:11.337457 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.337524 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:12:11.337556 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:11.350440 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.3:44359
I20240501 20:12:11.350452 1665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.3:44359 every 8 connection(s)
I20240501 20:12:11.356227 1666 heartbeater.cc:347] Connected to a master server at 127.0.100.62:37747
I20240501 20:12:11.356335 1666 heartbeater.cc:464] Registering TS with master...
I20240501 20:12:11.356658 1666 heartbeater.cc:511] Master 127.0.100.62:37747 requested a full tablet report, sending...
I20240501 20:12:11.357363 1390 ts_manager.cc:194] Registered new tserver with Master: e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:11.357998 400 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00672001s
I20240501 20:12:11.358011 1390 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48452
I20240501 20:12:11.358882 400 test_util.cc:268] Using random seed: 437122718
I20240501 20:12:11.369421 1390 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48460:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 20:12:11.370749 1390 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 20:12:11.426507 1626 tablet_service.cc:1467] Processing CreateTablet for tablet a197f73ccd5f41038acbd61a5a631c79 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 20:12:11.426561 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 206e6477b3ef4f9a90696dadebc33275 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 20:12:11.427069 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a197f73ccd5f41038acbd61a5a631c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.427002 1482 tablet_service.cc:1467] Processing CreateTablet for tablet fc7f9957429a40e48f910aea5f43624f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 20:12:11.427309 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 206e6477b3ef4f9a90696dadebc33275. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.427425 1482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc7f9957429a40e48f910aea5f43624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.427659 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 35fb57ac07c14ded9253288b2cf6b196 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 20:12:11.428037 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35fb57ac07c14ded9253288b2cf6b196. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.429767 1481 tablet_service.cc:1467] Processing CreateTablet for tablet 704a5fa4f8fa467b935ebe6c1bdf79a3 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 20:12:11.430145 1481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704a5fa4f8fa467b935ebe6c1bdf79a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.432166 1479 tablet_service.cc:1467] Processing CreateTablet for tablet 5f759565dcf84f43b14105cf6d3ca382 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 20:12:11.432487 1479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f759565dcf84f43b14105cf6d3ca382. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.433353 1628 tablet_service.cc:1467] Processing CreateTablet for tablet 5f759565dcf84f43b14105cf6d3ca382 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 20:12:11.433727 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f759565dcf84f43b14105cf6d3ca382. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.433807 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 45b2fb06d51e4f9cb28ac022594547d5 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 20:12:11.434625 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b2fb06d51e4f9cb28ac022594547d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.437348 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 4c353b8338de4b3b9f7b3d0f268e5577 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 20:12:11.437433 1480 tablet_service.cc:1467] Processing CreateTablet for tablet 4c353b8338de4b3b9f7b3d0f268e5577 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 20:12:11.437490 1622 tablet_service.cc:1467] Processing CreateTablet for tablet d175872525cd4a95b7d62121de228f79 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 20:12:11.437731 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c353b8338de4b3b9f7b3d0f268e5577. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.437824 1480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c353b8338de4b3b9f7b3d0f268e5577. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.437896 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d175872525cd4a95b7d62121de228f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.427029 1624 tablet_service.cc:1467] Processing CreateTablet for tablet e68951f3197141fabb5828e9e87545a8 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 20:12:11.441355 1630 tablet_service.cc:1467] Processing CreateTablet for tablet 704a5fa4f8fa467b935ebe6c1bdf79a3 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 20:12:11.441587 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68951f3197141fabb5828e9e87545a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.441915 1631 tablet_service.cc:1467] Processing CreateTablet for tablet fc7f9957429a40e48f910aea5f43624f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 20:12:11.442242 1631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc7f9957429a40e48f910aea5f43624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.443774 1622 tablet_service.cc:1467] Processing CreateTablet for tablet dc1c73dc1c684af1a5792ad2ab6e3fff (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 20:12:11.444082 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1c73dc1c684af1a5792ad2ab6e3fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.445151 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704a5fa4f8fa467b935ebe6c1bdf79a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.448246 1623 tablet_service.cc:1467] Processing CreateTablet for tablet aca56ce912074ec987a2d52e271e8c39 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 20:12:11.448655 1680 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:11.448724 1478 tablet_service.cc:1467] Processing CreateTablet for tablet 35fb57ac07c14ded9253288b2cf6b196 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 20:12:11.449318 1477 tablet_service.cc:1467] Processing CreateTablet for tablet a197f73ccd5f41038acbd61a5a631c79 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 20:12:11.449705 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a197f73ccd5f41038acbd61a5a631c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.450903 1680 tablet_bootstrap.cc:654] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.452217 1625 tablet_service.cc:1467] Processing CreateTablet for tablet b04ba7f3ce10406fb8c299b54fa3299b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 20:12:11.452816 1681 tablet_bootstrap.cc:492] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:11.453276 1476 tablet_service.cc:1467] Processing CreateTablet for tablet 206e6477b3ef4f9a90696dadebc33275 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 20:12:11.453327 1475 tablet_service.cc:1467] Processing CreateTablet for tablet e68951f3197141fabb5828e9e87545a8 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 20:12:11.453681 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 206e6477b3ef4f9a90696dadebc33275. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.453766 1473 tablet_service.cc:1467] Processing CreateTablet for tablet d175872525cd4a95b7d62121de228f79 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 20:12:11.454162 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d175872525cd4a95b7d62121de228f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.454396 1681 tablet_bootstrap.cc:654] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.456439 1680 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:11.456586 1680 ts_tablet_manager.cc:1367] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20240501 20:12:11.457250 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68951f3197141fabb5828e9e87545a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.457358 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 45b2fb06d51e4f9cb28ac022594547d5 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 20:12:11.457374 1680 raft_consensus.cc:348] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.457584 1680 raft_consensus.cc:374] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.457643 1680 raft_consensus.cc:729] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.457857 1680 consensus_queue.cc:260] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.459168 1481 tablet_service.cc:1467] Processing CreateTablet for tablet dc1c73dc1c684af1a5792ad2ab6e3fff (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 20:12:11.459590 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04ba7f3ce10406fb8c299b54fa3299b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.459738 1631 tablet_service.cc:1467] Processing CreateTablet for tablet fb27ad1cad004e74896f221012308e97 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 20:12:11.460078 1631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb27ad1cad004e74896f221012308e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.460566 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35fb57ac07c14ded9253288b2cf6b196. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.460546 1627 tablet_service.cc:1467] Processing CreateTablet for tablet e369ffe23d6b4eb58c8031d82cc89e3b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 20:12:11.460896 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca56ce912074ec987a2d52e271e8c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.461851 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b2fb06d51e4f9cb28ac022594547d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.462085 1481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1c73dc1c684af1a5792ad2ab6e3fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.462425 1482 tablet_service.cc:1467] Processing CreateTablet for tablet aca56ce912074ec987a2d52e271e8c39 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 20:12:11.462760 1482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca56ce912074ec987a2d52e271e8c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.464311 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e369ffe23d6b4eb58c8031d82cc89e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.466315 1624 tablet_service.cc:1467] Processing CreateTablet for tablet e390a9bcddb34c7eb4d9f91a0a889a5d (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 20:12:11.466742 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e390a9bcddb34c7eb4d9f91a0a889a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.467401 1630 tablet_service.cc:1467] Processing CreateTablet for tablet 0a9d9af841834c8bac7406a2dbad0b55 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 20:12:11.467820 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a9d9af841834c8bac7406a2dbad0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.469671 1479 tablet_service.cc:1467] Processing CreateTablet for tablet b04ba7f3ce10406fb8c299b54fa3299b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 20:12:11.470021 1479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04ba7f3ce10406fb8c299b54fa3299b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.470887 1622 tablet_service.cc:1467] Processing CreateTablet for tablet fbe80020f28649a79752351baff072a2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 20:12:11.471215 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbe80020f28649a79752351baff072a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.471491 1480 tablet_service.cc:1467] Processing CreateTablet for tablet e369ffe23d6b4eb58c8031d82cc89e3b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 20:12:11.472016 1480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e369ffe23d6b4eb58c8031d82cc89e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.473575 1628 tablet_service.cc:1467] Processing CreateTablet for tablet 91bf896d96b341a9bc7125b68797a9b2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 20:12:11.477108 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 500fba598d2e4c858888998c3e3d2080 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 20:12:11.477466 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 500fba598d2e4c858888998c3e3d2080. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.477496 1473 tablet_service.cc:1467] Processing CreateTablet for tablet fb27ad1cad004e74896f221012308e97 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 20:12:11.477847 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb27ad1cad004e74896f221012308e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.478062 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bf896d96b341a9bc7125b68797a9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.485272 1680 ts_tablet_manager.cc:1398] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.029s user 0.008s sys 0.008s
I20240501 20:12:11.485277 1666 heartbeater.cc:503] Master 127.0.100.62:37747 was elected leader, sending a full tablet report...
I20240501 20:12:11.485918 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 0a9d9af841834c8bac7406a2dbad0b55 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 20:12:11.486330 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a9d9af841834c8bac7406a2dbad0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.487284 1680 tablet_bootstrap.cc:492] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:11.496163 1681 tablet_bootstrap.cc:492] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:11.496289 1681 ts_tablet_manager.cc:1367] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.009s
I20240501 20:12:11.498723 1625 tablet_service.cc:1467] Processing CreateTablet for tablet c88aa6fcedc6495ba20b1e5a5a59a554 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 20:12:11.499078 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c88aa6fcedc6495ba20b1e5a5a59a554. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.507941 1476 tablet_service.cc:1467] Processing CreateTablet for tablet e390a9bcddb34c7eb4d9f91a0a889a5d (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 20:12:11.509327 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e390a9bcddb34c7eb4d9f91a0a889a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.510660 1681 raft_consensus.cc:348] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.510805 1681 raft_consensus.cc:374] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.510845 1681 raft_consensus.cc:729] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.511726 1475 tablet_service.cc:1467] Processing CreateTablet for tablet fbe80020f28649a79752351baff072a2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 20:12:11.512054 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbe80020f28649a79752351baff072a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.517340 1681 consensus_queue.cc:260] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.520830 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 259e5b9c72f84518b1269ce8688ef32f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 20:12:11.522457 1478 tablet_service.cc:1467] Processing CreateTablet for tablet 91bf896d96b341a9bc7125b68797a9b2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 20:12:11.524232 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 259e5b9c72f84518b1269ce8688ef32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.525118 1479 tablet_service.cc:1467] Processing CreateTablet for tablet c88aa6fcedc6495ba20b1e5a5a59a554 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 20:12:11.527362 1480 tablet_service.cc:1467] Processing CreateTablet for tablet 259e5b9c72f84518b1269ce8688ef32f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 20:12:11.530620 1626 tablet_service.cc:1467] Processing CreateTablet for tablet f46990a85ef946b0b40127c23e2696e9 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 20:12:11.531069 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f46990a85ef946b0b40127c23e2696e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.532496 1479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c88aa6fcedc6495ba20b1e5a5a59a554. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.533835 1481 tablet_service.cc:1467] Processing CreateTablet for tablet 500fba598d2e4c858888998c3e3d2080 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 20:12:11.536851 1480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 259e5b9c72f84518b1269ce8688ef32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.538055 1517 heartbeater.cc:503] Master 127.0.100.62:37747 was elected leader, sending a full tablet report...
I20240501 20:12:11.538772 1474 tablet_service.cc:1467] Processing CreateTablet for tablet f46990a85ef946b0b40127c23e2696e9 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 20:12:11.538898 1680 tablet_bootstrap.cc:654] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.540863 1681 ts_tablet_manager.cc:1398] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.042s user 0.001s sys 0.013s
I20240501 20:12:11.540910 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bf896d96b341a9bc7125b68797a9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.541592 1482 tablet_service.cc:1467] Processing CreateTablet for tablet 802bbe84710b48be9d9ee6a15279ff9b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 20:12:11.542574 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 802bbe84710b48be9d9ee6a15279ff9b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 20:12:11.543982 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f46990a85ef946b0b40127c23e2696e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.545027 1681 tablet_bootstrap.cc:492] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:11.547634 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 802bbe84710b48be9d9ee6a15279ff9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.548084 1482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 802bbe84710b48be9d9ee6a15279ff9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.550956 1630 tablet_service.cc:1467] Processing CreateTablet for tablet dd0c2f09e028435abb4a0660e637cefb (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 20:12:11.551169 1473 tablet_service.cc:1467] Processing CreateTablet for tablet 614478290e894be8956ebca5615d791b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 20:12:11.551472 1481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 500fba598d2e4c858888998c3e3d2080. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.552189 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614478290e894be8956ebca5615d791b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.553061 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 614478290e894be8956ebca5615d791b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 20:12:11.554597 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd0c2f09e028435abb4a0660e637cefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.554942 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614478290e894be8956ebca5615d791b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.555527 1557 tablet_service.cc:1467] Processing CreateTablet for tablet fc7f9957429a40e48f910aea5f43624f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 20:12:11.555505 1631 tablet_service.cc:1467] Processing CreateTablet for tablet 73c4f81d151c4ed5ac6b7ecba2803d08 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 20:12:11.555949 1631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c4f81d151c4ed5ac6b7ecba2803d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.555994 1557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc7f9957429a40e48f910aea5f43624f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.555996 1681 tablet_bootstrap.cc:654] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.555577 1555 tablet_service.cc:1467] Processing CreateTablet for tablet 4c353b8338de4b3b9f7b3d0f268e5577 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 20:12:11.558079 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 5f759565dcf84f43b14105cf6d3ca382 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 20:12:11.560653 1556 tablet_service.cc:1467] Processing CreateTablet for tablet 704a5fa4f8fa467b935ebe6c1bdf79a3 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 20:12:11.562898 1555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c353b8338de4b3b9f7b3d0f268e5577. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.569280 1552 tablet_service.cc:1467] Processing CreateTablet for tablet a197f73ccd5f41038acbd61a5a631c79 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 20:12:11.570428 1549 tablet_service.cc:1467] Processing CreateTablet for tablet 45b2fb06d51e4f9cb28ac022594547d5 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 20:12:11.570488 1548 tablet_service.cc:1467] Processing CreateTablet for tablet d175872525cd4a95b7d62121de228f79 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 20:12:11.572477 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f759565dcf84f43b14105cf6d3ca382. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.572415 1628 tablet_service.cc:1467] Processing CreateTablet for tablet 055a0d2bb3c047aea3f375153145cb42 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 20:12:11.571143 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 35fb57ac07c14ded9253288b2cf6b196 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 20:12:11.576471 1622 tablet_service.cc:1467] Processing CreateTablet for tablet 32b168a9a8104ccbab55dfc28be4a612 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 20:12:11.571782 1551 tablet_service.cc:1467] Processing CreateTablet for tablet 206e6477b3ef4f9a90696dadebc33275 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 20:12:11.571835 1550 tablet_service.cc:1467] Processing CreateTablet for tablet e68951f3197141fabb5828e9e87545a8 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 20:12:11.579432 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055a0d2bb3c047aea3f375153145cb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.581213 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a197f73ccd5f41038acbd61a5a631c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.582314 1627 tablet_service.cc:1467] Processing CreateTablet for tablet c13c2438cee84fcc9d98256bbf641222 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 20:12:11.584198 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b2fb06d51e4f9cb28ac022594547d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.584429 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35fb57ac07c14ded9253288b2cf6b196. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.584640 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d175872525cd4a95b7d62121de228f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.584872 1556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 704a5fa4f8fa467b935ebe6c1bdf79a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.585078 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68951f3197141fabb5828e9e87545a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.585472 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 206e6477b3ef4f9a90696dadebc33275. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.587085 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32b168a9a8104ccbab55dfc28be4a612. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.588990 1475 tablet_service.cc:1467] Processing CreateTablet for tablet dd0c2f09e028435abb4a0660e637cefb (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 20:12:11.590042 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd0c2f09e028435abb4a0660e637cefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.591097 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13c2438cee84fcc9d98256bbf641222. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.604667 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 73c4f81d151c4ed5ac6b7ecba2803d08 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 20:12:11.605199 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c4f81d151c4ed5ac6b7ecba2803d08. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 20:12:11.608091 1667 tablet.cc:2369] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 20:12:11.610373 1680 tablet_bootstrap.cc:492] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:11.610565 1680 ts_tablet_manager.cc:1367] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.123s user 0.006s sys 0.021s
I20240501 20:12:11.611456 1680 raft_consensus.cc:348] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.631723 1680 raft_consensus.cc:374] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.632591 1680 raft_consensus.cc:729] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.633031 1552 tablet_service.cc:1467] Processing CreateTablet for tablet dc1c73dc1c684af1a5792ad2ab6e3fff (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 20:12:11.634002 1688 tablet_bootstrap.cc:492] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:11.635185 1556 tablet_service.cc:1467] Processing CreateTablet for tablet b04ba7f3ce10406fb8c299b54fa3299b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 20:12:11.639300 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1c73dc1c684af1a5792ad2ab6e3fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.636894 1553 tablet_service.cc:1467] Processing CreateTablet for tablet aca56ce912074ec987a2d52e271e8c39 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 20:12:11.640676 1476 tablet_service.cc:1467] Processing CreateTablet for tablet 32b168a9a8104ccbab55dfc28be4a612 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 20:12:11.640763 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 055a0d2bb3c047aea3f375153145cb42 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 20:12:11.640723 1550 tablet_service.cc:1467] Processing CreateTablet for tablet fb27ad1cad004e74896f221012308e97 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 20:12:11.641173 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32b168a9a8104ccbab55dfc28be4a612. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.641242 1680 consensus_queue.cc:260] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.641471 1556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04ba7f3ce10406fb8c299b54fa3299b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.641427 1548 tablet_service.cc:1467] Processing CreateTablet for tablet e369ffe23d6b4eb58c8031d82cc89e3b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 20:12:11.644939 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055a0d2bb3c047aea3f375153145cb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.645709 1475 tablet_service.cc:1467] Processing CreateTablet for tablet c13c2438cee84fcc9d98256bbf641222 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 20:12:11.646100 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13c2438cee84fcc9d98256bbf641222. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.646590 1625 tablet_service.cc:1467] Processing CreateTablet for tablet f3da872ddf5d48e1a7c2f7f297a93bb1 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 20:12:11.648643 1680 ts_tablet_manager.cc:1398] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.032s user 0.001s sys 0.002s
I20240501 20:12:11.648761 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca56ce912074ec987a2d52e271e8c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.650084 1480 tablet_service.cc:1467] Processing CreateTablet for tablet f3da872ddf5d48e1a7c2f7f297a93bb1 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 20:12:11.649978 1681 tablet_bootstrap.cc:492] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:11.652655 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3da872ddf5d48e1a7c2f7f297a93bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.653460 1481 tablet_service.cc:1467] Processing CreateTablet for tablet d88af9fa98d343d4a1f00181f0eb5162 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 20:12:11.654099 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 599e699186cd4a8ebf71634a746d7f1a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 20:12:11.654747 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e369ffe23d6b4eb58c8031d82cc89e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.657037 1480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3da872ddf5d48e1a7c2f7f297a93bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.657326 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599e699186cd4a8ebf71634a746d7f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.657366 1680 tablet_bootstrap.cc:492] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:11.659046 1681 ts_tablet_manager.cc:1367] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.109s user 0.019s sys 0.014s
I20240501 20:12:11.663188 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb27ad1cad004e74896f221012308e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.665558 1481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d88af9fa98d343d4a1f00181f0eb5162. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.672597 1626 tablet_service.cc:1467] Processing CreateTablet for tablet d88af9fa98d343d4a1f00181f0eb5162 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 20:12:11.674154 1557 tablet_service.cc:1467] Processing CreateTablet for tablet 0a9d9af841834c8bac7406a2dbad0b55 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 20:12:11.674173 1555 tablet_service.cc:1467] Processing CreateTablet for tablet e390a9bcddb34c7eb4d9f91a0a889a5d (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 20:12:11.674600 1557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a9d9af841834c8bac7406a2dbad0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.675484 1555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e390a9bcddb34c7eb4d9f91a0a889a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.676116 1681 raft_consensus.cc:348] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:11.676350 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d88af9fa98d343d4a1f00181f0eb5162. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.676920 1479 tablet_service.cc:1467] Processing CreateTablet for tablet 0b62689a9a324b1293e98ef3d09f2419 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 20:12:11.679522 1479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b62689a9a324b1293e98ef3d09f2419. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.681649 1681 raft_consensus.cc:374] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.684108 1680 tablet_bootstrap.cc:654] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.684015 1478 tablet_service.cc:1467] Processing CreateTablet for tablet f379c9b447af4fb29e6081a1f9e901ec (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 20:12:11.684376 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f379c9b447af4fb29e6081a1f9e901ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.684758 1681 raft_consensus.cc:729] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.686204 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 599e699186cd4a8ebf71634a746d7f1a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 20:12:11.686528 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599e699186cd4a8ebf71634a746d7f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.686944 1473 tablet_service.cc:1467] Processing CreateTablet for tablet 34308521f7b7481fafef0344fec556f2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 20:12:11.687197 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34308521f7b7481fafef0344fec556f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.685768 1681 consensus_queue.cc:260] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:11.692837 1631 tablet_service.cc:1467] Processing CreateTablet for tablet 0b62689a9a324b1293e98ef3d09f2419 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 20:12:11.693235 1631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b62689a9a324b1293e98ef3d09f2419. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.695242 1681 ts_tablet_manager.cc:1398] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.036s user 0.000s sys 0.002s
I20240501 20:12:11.695677 1681 tablet_bootstrap.cc:492] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:11.698897 1684 raft_consensus.cc:482] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:11.702785 1628 tablet_service.cc:1467] Processing CreateTablet for tablet f379c9b447af4fb29e6081a1f9e901ec (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 20:12:11.703119 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f379c9b447af4fb29e6081a1f9e901ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.699031 1684 raft_consensus.cc:504] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.706414 1551 tablet_service.cc:1467] Processing CreateTablet for tablet fbe80020f28649a79752351baff072a2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 20:12:11.709278 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbe80020f28649a79752351baff072a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.710369 1684 leader_election.cc:288] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:11.713181 1624 tablet_service.cc:1467] Processing CreateTablet for tablet 34308521f7b7481fafef0344fec556f2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 20:12:11.713557 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34308521f7b7481fafef0344fec556f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.719046 1482 tablet_service.cc:1467] Processing CreateTablet for tablet 19a3e65d25d74d469efe3fdd86b6e360 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 20:12:11.719408 1482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a3e65d25d74d469efe3fdd86b6e360. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.722501 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 19a3e65d25d74d469efe3fdd86b6e360 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 20:12:11.722884 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a3e65d25d74d469efe3fdd86b6e360. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.725891 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 91bf896d96b341a9bc7125b68797a9b2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 20:12:11.726329 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bf896d96b341a9bc7125b68797a9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.727808 1688 tablet_bootstrap.cc:654] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.728120 1622 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6c65585f2c40c5bc072744c8b7b183 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 20:12:11.730450 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f6c65585f2c40c5bc072744c8b7b183. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.738982 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd7cfd1931740538e0225f4ae54a11b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 20:12:11.739323 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd7cfd1931740538e0225f4ae54a11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.746106 1681 tablet_bootstrap.cc:654] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.747114 1549 tablet_service.cc:1467] Processing CreateTablet for tablet 500fba598d2e4c858888998c3e3d2080 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 20:12:11.748932 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 500fba598d2e4c858888998c3e3d2080. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.750077 1548 tablet_service.cc:1467] Processing CreateTablet for tablet c88aa6fcedc6495ba20b1e5a5a59a554 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 20:12:11.750489 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c88aa6fcedc6495ba20b1e5a5a59a554. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.752576 1630 tablet_service.cc:1467] Processing CreateTablet for tablet d5a1b45e9be5446cb5ad18906381d9fd (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 20:12:11.752925 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a1b45e9be5446cb5ad18906381d9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.756997 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 259e5b9c72f84518b1269ce8688ef32f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 20:12:11.757395 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 259e5b9c72f84518b1269ce8688ef32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.765893 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6c65585f2c40c5bc072744c8b7b183 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 20:12:11.766242 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f6c65585f2c40c5bc072744c8b7b183. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.768265 1476 tablet_service.cc:1467] Processing CreateTablet for tablet d5a1b45e9be5446cb5ad18906381d9fd (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 20:12:11.769836 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a1b45e9be5446cb5ad18906381d9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.768682 1623 tablet_service.cc:1467] Processing CreateTablet for tablet c95b72ede9fc487b87490e2d4a75e261 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 20:12:11.767724 1481 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd7cfd1931740538e0225f4ae54a11b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 20:12:11.770860 1481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd7cfd1931740538e0225f4ae54a11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.777526 1630 tablet_service.cc:1467] Processing CreateTablet for tablet 17b0ff3e282b40c9b3feb276bf62f02f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 20:12:11.778652 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c95b72ede9fc487b87490e2d4a75e261. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.784386 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17b0ff3e282b40c9b3feb276bf62f02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.789435 1680 tablet_bootstrap.cc:492] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:11.789570 1680 ts_tablet_manager.cc:1367] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.138s user 0.042s sys 0.019s
I20240501 20:12:11.790838 1557 tablet_service.cc:1467] Processing CreateTablet for tablet f46990a85ef946b0b40127c23e2696e9 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 20:12:11.791210 1557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f46990a85ef946b0b40127c23e2696e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.795944 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 802bbe84710b48be9d9ee6a15279ff9b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 20:12:11.797169 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 614478290e894be8956ebca5615d791b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 20:12:11.797475 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614478290e894be8956ebca5615d791b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.798444 1473 tablet_service.cc:1467] Processing CreateTablet for tablet c95b72ede9fc487b87490e2d4a75e261 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 20:12:11.800169 1475 tablet_service.cc:1467] Processing CreateTablet for tablet 17b0ff3e282b40c9b3feb276bf62f02f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 20:12:11.800487 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17b0ff3e282b40c9b3feb276bf62f02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.802757 1622 tablet_service.cc:1467] Processing CreateTablet for tablet c98df9e665f744c88e3edd852ee06f96 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 20:12:11.803933 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 802bbe84710b48be9d9ee6a15279ff9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.804929 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c95b72ede9fc487b87490e2d4a75e261. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.805245 1555 tablet_service.cc:1467] Processing CreateTablet for tablet dd0c2f09e028435abb4a0660e637cefb (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 20:12:11.805383 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c98df9e665f744c88e3edd852ee06f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.805600 1555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd0c2f09e028435abb4a0660e637cefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.818466 1481 tablet_service.cc:1467] Processing CreateTablet for tablet fe821f07300b4cc4a3e616b989b8592f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 20:12:11.818991 1481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe821f07300b4cc4a3e616b989b8592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.820809 1626 tablet_service.cc:1467] Processing CreateTablet for tablet fe821f07300b4cc4a3e616b989b8592f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 20:12:11.821206 1626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe821f07300b4cc4a3e616b989b8592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.822813 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 43925e23a6cc4c3e9fbb3b33cf39d72a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 20:12:11.823127 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43925e23a6cc4c3e9fbb3b33cf39d72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.823958 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 4f37d944d0d844828f7d97eeac371d0a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 20:12:11.824280 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f37d944d0d844828f7d97eeac371d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.825297 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 43925e23a6cc4c3e9fbb3b33cf39d72a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 20:12:11.825606 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43925e23a6cc4c3e9fbb3b33cf39d72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.825537 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 73c4f81d151c4ed5ac6b7ecba2803d08 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 20:12:11.825850 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73c4f81d151c4ed5ac6b7ecba2803d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.826205 1480 tablet_service.cc:1467] Processing CreateTablet for tablet c98df9e665f744c88e3edd852ee06f96 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 20:12:11.834445 1480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c98df9e665f744c88e3edd852ee06f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.836061 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 055a0d2bb3c047aea3f375153145cb42 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 20:12:11.836153 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 32b168a9a8104ccbab55dfc28be4a612 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 20:12:11.836400 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32b168a9a8104ccbab55dfc28be4a612. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.838927 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 4f37d944d0d844828f7d97eeac371d0a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 20:12:11.839246 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055a0d2bb3c047aea3f375153145cb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.842634 1477 tablet_service.cc:1467] Processing CreateTablet for tablet 4126cea4e4a04d81a41f81c42d218866 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 20:12:11.842634 1556 tablet_service.cc:1467] Processing CreateTablet for tablet c13c2438cee84fcc9d98256bbf641222 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 20:12:11.845336 1556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c13c2438cee84fcc9d98256bbf641222. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.845394 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 4126cea4e4a04d81a41f81c42d218866 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 20:12:11.845746 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4126cea4e4a04d81a41f81c42d218866. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.846220 1479 tablet_service.cc:1467] Processing CreateTablet for tablet fd28f411966a432aa3a8cca7076c3ca7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 20:12:11.846520 1479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd28f411966a432aa3a8cca7076c3ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.846858 1685 raft_consensus.cc:482] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:11.846994 1685 raft_consensus.cc:504] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:11.848007 1478 tablet_service.cc:1467] Processing CreateTablet for tablet c41682f6de504ad78a616818b19493bc (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 20:12:11.848232 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f37d944d0d844828f7d97eeac371d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.848448 1477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4126cea4e4a04d81a41f81c42d218866. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.848544 1684 raft_consensus.cc:482] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:11.848678 1684 raft_consensus.cc:504] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.849284 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41682f6de504ad78a616818b19493bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.850356 1684 leader_election.cc:288] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:11.851230 1631 tablet_service.cc:1467] Processing CreateTablet for tablet fd28f411966a432aa3a8cca7076c3ca7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 20:12:11.851541 1631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd28f411966a432aa3a8cca7076c3ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.852886 1680 raft_consensus.cc:348] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.853091 1680 raft_consensus.cc:374] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.853147 1680 raft_consensus.cc:729] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.855113 1685 leader_election.cc:288] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:11.859740 1680 consensus_queue.cc:260] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.861366 1680 ts_tablet_manager.cc:1398] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.072s user 0.002s sys 0.000s
I20240501 20:12:11.861579 1680 tablet_bootstrap.cc:492] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:11.862905 1680 tablet_bootstrap.cc:654] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.865622 1549 tablet_service.cc:1467] Processing CreateTablet for tablet f3da872ddf5d48e1a7c2f7f297a93bb1 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 20:12:11.866068 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3da872ddf5d48e1a7c2f7f297a93bb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.871065 1548 tablet_service.cc:1467] Processing CreateTablet for tablet d88af9fa98d343d4a1f00181f0eb5162 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 20:12:11.871399 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d88af9fa98d343d4a1f00181f0eb5162. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.873380 1476 tablet_service.cc:1467] Processing CreateTablet for tablet e2f2a248c4924e539a7faea914ed64b7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 20:12:11.873777 1476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f2a248c4924e539a7faea914ed64b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.875481 1628 tablet_service.cc:1467] Processing CreateTablet for tablet c41682f6de504ad78a616818b19493bc (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 20:12:11.875769 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41682f6de504ad78a616818b19493bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.877373 1624 tablet_service.cc:1467] Processing CreateTablet for tablet e2f2a248c4924e539a7faea914ed64b7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 20:12:11.877755 1624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f2a248c4924e539a7faea914ed64b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.893270 1681 tablet_bootstrap.cc:492] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:11.893409 1681 ts_tablet_manager.cc:1367] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.198s user 0.039s sys 0.047s
I20240501 20:12:11.898804 1629 tablet_service.cc:1467] Processing CreateTablet for tablet 9fb7d6d5f5824535bd64f429ef8f0693 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 20:12:11.899207 1629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fb7d6d5f5824535bd64f429ef8f0693. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.901131 1551 tablet_service.cc:1467] Processing CreateTablet for tablet 599e699186cd4a8ebf71634a746d7f1a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 20:12:11.901525 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 599e699186cd4a8ebf71634a746d7f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.902401 1473 tablet_service.cc:1467] Processing CreateTablet for tablet 9fb7d6d5f5824535bd64f429ef8f0693 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 20:12:11.902776 1473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fb7d6d5f5824535bd64f429ef8f0693. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.905891 1475 tablet_service.cc:1467] Processing CreateTablet for tablet 880cb9bb122a4337bb96b871a9cef339 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 20:12:11.906203 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 880cb9bb122a4337bb96b871a9cef339. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.909852 1482 tablet_service.cc:1467] Processing CreateTablet for tablet a961f26ce8d04b78a0e7d25fe8bbdfeb (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 20:12:11.910179 1482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a961f26ce8d04b78a0e7d25fe8bbdfeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.909407 1681 raft_consensus.cc:348] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.910764 1681 raft_consensus.cc:374] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.910835 1681 raft_consensus.cc:729] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.917629 1681 consensus_queue.cc:260] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.927531 1480 tablet_service.cc:1467] Processing CreateTablet for tablet c3c51e1cc64e4cc9bd2dc97403a28759 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 20:12:11.927855 1480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c51e1cc64e4cc9bd2dc97403a28759. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.932914 1554 tablet_service.cc:1467] Processing CreateTablet for tablet 0b62689a9a324b1293e98ef3d09f2419 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 20:12:11.933632 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b62689a9a324b1293e98ef3d09f2419. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.933789 1479 tablet_service.cc:1467] Processing CreateTablet for tablet 6a46c25fb679479183f9803a9ad3c0c0 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 20:12:11.934084 1479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a46c25fb679479183f9803a9ad3c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.938191 1623 tablet_service.cc:1467] Processing CreateTablet for tablet 880cb9bb122a4337bb96b871a9cef339 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 20:12:11.939783 1481 tablet_service.cc:1467] Processing CreateTablet for tablet 873087761cda482f8756584663220652 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 20:12:11.940340 1557 tablet_service.cc:1467] Processing CreateTablet for tablet f379c9b447af4fb29e6081a1f9e901ec (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 20:12:11.940645 1557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f379c9b447af4fb29e6081a1f9e901ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.941509 1623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 880cb9bb122a4337bb96b871a9cef339. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.942909 1481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873087761cda482f8756584663220652. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.943619 1630 tablet_service.cc:1467] Processing CreateTablet for tablet a961f26ce8d04b78a0e7d25fe8bbdfeb (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 20:12:11.888509 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:11.944626 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a961f26ce8d04b78a0e7d25fe8bbdfeb. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 20:12:11.945518 1604 leader_election.cc:341] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:11.889871 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "206e6477b3ef4f9a90696dadebc33275" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:11.892951 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "206e6477b3ef4f9a90696dadebc33275" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:11.894269 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:11.946349 1606 leader_election.cc:341] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:11.946518 1606 leader_election.cc:341] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:11.946583 1606 leader_election.cc:302] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:11.947783 1625 tablet_service.cc:1467] Processing CreateTablet for tablet 6a46c25fb679479183f9803a9ad3c0c0 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 20:12:11.948122 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a46c25fb679479183f9803a9ad3c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.948592 1684 raft_consensus.cc:2726] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240501 20:12:11.948774 1604 leader_election.cc:341] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:11.951100 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 34308521f7b7481fafef0344fec556f2 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 20:12:11.952104 1684 raft_consensus.cc:482] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:11.952239 1684 raft_consensus.cc:504] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.952530 1604 leader_election.cc:302] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:11.952939 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34308521f7b7481fafef0344fec556f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.954885 1684 leader_election.cc:288] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:11.955026 1684 raft_consensus.cc:2726] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:11.956425 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b2fb06d51e4f9cb28ac022594547d5" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:11.956949 1680 tablet_bootstrap.cc:492] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:11.957093 1680 ts_tablet_manager.cc:1367] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.003s
W20240501 20:12:11.957376 1606 leader_election.cc:341] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:11.958804 1688 tablet_bootstrap.cc:492] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:11.958932 1688 ts_tablet_manager.cc:1367] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.342s user 0.034s sys 0.027s
I20240501 20:12:11.960286 1680 raft_consensus.cc:348] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.960448 1680 raft_consensus.cc:374] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.960489 1680 raft_consensus.cc:729] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.960549 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 19a3e65d25d74d469efe3fdd86b6e360 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 20:12:11.960659 1680 consensus_queue.cc:260] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.960855 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a3e65d25d74d469efe3fdd86b6e360. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.961076 1631 tablet_service.cc:1467] Processing CreateTablet for tablet c3c51e1cc64e4cc9bd2dc97403a28759 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 20:12:11.961445 1631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c51e1cc64e4cc9bd2dc97403a28759. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.961174 1680 ts_tablet_manager.cc:1398] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:12:11.962455 1680 tablet_bootstrap.cc:492] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:11.965184 1627 tablet_service.cc:1467] Processing CreateTablet for tablet 873087761cda482f8756584663220652 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 20:12:11.967927 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873087761cda482f8756584663220652. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.968041 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6c65585f2c40c5bc072744c8b7b183 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 20:12:11.968324 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f6c65585f2c40c5bc072744c8b7b183. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.969321 1622 tablet_service.cc:1467] Processing CreateTablet for tablet 29e32716adda49f9b25a5cad3ed195b9 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 20:12:11.969610 1622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e32716adda49f9b25a5cad3ed195b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.972141 1680 tablet_bootstrap.cc:654] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:11.973527 1474 tablet_service.cc:1467] Processing CreateTablet for tablet 29e32716adda49f9b25a5cad3ed195b9 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 20:12:11.973814 1474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e32716adda49f9b25a5cad3ed195b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.978233 1688 raft_consensus.cc:348] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.978557 1688 raft_consensus.cc:374] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:11.978663 1688 raft_consensus.cc:729] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:11.979077 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc7f9957429a40e48f910aea5f43624f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
W20240501 20:12:11.981076 1457 leader_election.cc:341] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:11.984755 1478 tablet_service.cc:1467] Processing CreateTablet for tablet 38b9253ebcd94335aee17a5b039e712a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 20:12:11.985103 1478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b9253ebcd94335aee17a5b039e712a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.985024 1628 tablet_service.cc:1467] Processing CreateTablet for tablet 38b9253ebcd94335aee17a5b039e712a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 20:12:11.986642 1628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b9253ebcd94335aee17a5b039e712a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.989351 1625 tablet_service.cc:1467] Processing CreateTablet for tablet d9178c194e31432eb382d89615c2c7d7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 20:12:11.989699 1625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9178c194e31432eb382d89615c2c7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.991057 1475 tablet_service.cc:1467] Processing CreateTablet for tablet d9178c194e31432eb382d89615c2c7d7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 20:12:11.978914 1688 consensus_queue.cc:260] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:11.991731 1475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9178c194e31432eb382d89615c2c7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:11.990744 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd7cfd1931740538e0225f4ae54a11b (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 20:12:11.993806 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd7cfd1931740538e0225f4ae54a11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.000645 1685 raft_consensus.cc:482] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.000761 1685 raft_consensus.cc:504] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.001782 1685 leader_election.cc:288] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.003531 1549 tablet_service.cc:1467] Processing CreateTablet for tablet d5a1b45e9be5446cb5ad18906381d9fd (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 20:12:12.003950 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a1b45e9be5446cb5ad18906381d9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.005587 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704a5fa4f8fa467b935ebe6c1bdf79a3" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
W20240501 20:12:12.006244 1457 leader_election.cc:341] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:12.008714 1604 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.100.1:44831, user_credentials={real_user=slave}} blocked reactor thread for 62340.6us
I20240501 20:12:12.009095 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc7f9957429a40e48f910aea5f43624f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.009405 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704a5fa4f8fa467b935ebe6c1bdf79a3" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:12.009924 1457 leader_election.cc:341] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.010031 1457 leader_election.cc:302] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.010244 1554 tablet_service.cc:1467] Processing CreateTablet for tablet c95b72ede9fc487b87490e2d4a75e261 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20240501 20:12:12.010352 1457 leader_election.cc:341] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.010423 1457 leader_election.cc:302] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.010425 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b2fb06d51e4f9cb28ac022594547d5" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.010550 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c95b72ede9fc487b87490e2d4a75e261. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.010830 1685 raft_consensus.cc:2726] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.011000 1685 raft_consensus.cc:2726] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.019198 1698 raft_consensus.cc:482] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.019376 1592 heartbeater.cc:503] Master 127.0.100.62:37747 was elected leader, sending a full tablet report...
I20240501 20:12:12.019326 1698 raft_consensus.cc:504] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.020179 1698 leader_election.cc:288] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
W20240501 20:12:12.010972 1604 leader_election.cc:341] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.020337 1604 leader_election.cc:302] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.020777 1684 raft_consensus.cc:2726] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.021531 1680 tablet_bootstrap.cc:492] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.021663 1680 ts_tablet_manager.cc:1367] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20240501 20:12:12.022419 1680 raft_consensus.cc:348] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:12.022586 1680 raft_consensus.cc:374] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.022631 1680 raft_consensus.cc:729] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.022807 1680 consensus_queue.cc:260] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:12.023313 1680 ts_tablet_manager.cc:1398] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.024049 1680 tablet_bootstrap.cc:492] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.025635 1680 tablet_bootstrap.cc:654] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.029808 1556 tablet_service.cc:1467] Processing CreateTablet for tablet 17b0ff3e282b40c9b3feb276bf62f02f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 20:12:12.030169 1556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17b0ff3e282b40c9b3feb276bf62f02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.033619 1555 tablet_service.cc:1467] Processing CreateTablet for tablet c98df9e665f744c88e3edd852ee06f96 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 20:12:12.036262 1555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c98df9e665f744c88e3edd852ee06f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.040735 1552 tablet_service.cc:1467] Processing CreateTablet for tablet 4126cea4e4a04d81a41f81c42d218866 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 20:12:12.035871 1556 tablet_service.cc:1467] Processing CreateTablet for tablet 43925e23a6cc4c3e9fbb3b33cf39d72a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 20:12:12.041100 1684 raft_consensus.cc:482] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.035128 1554 tablet_service.cc:1467] Processing CreateTablet for tablet fe821f07300b4cc4a3e616b989b8592f (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 20:12:12.041247 1684 raft_consensus.cc:504] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:12.041860 1684 leader_election.cc:288] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.044441 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc7f9957429a40e48f910aea5f43624f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.044622 1491 raft_consensus.cc:2454] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.045655 1604 leader_election.cc:302] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.046545 1696 raft_consensus.cc:2781] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.046730 1696 raft_consensus.cc:482] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.046911 1696 raft_consensus.cc:3037] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.047694 1552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4126cea4e4a04d81a41f81c42d218866. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.047868 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe821f07300b4cc4a3e616b989b8592f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.048847 1556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43925e23a6cc4c3e9fbb3b33cf39d72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.055024 1688 ts_tablet_manager.cc:1398] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.096s user 0.009s sys 0.000s
I20240501 20:12:12.057404 1696 raft_consensus.cc:504] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:12.062621 1680 tablet_bootstrap.cc:492] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.062747 1680 ts_tablet_manager.cc:1367] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.002s
I20240501 20:12:12.063020 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc7f9957429a40e48f910aea5f43624f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.063163 1491 raft_consensus.cc:3037] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.063424 1680 raft_consensus.cc:348] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.063584 1680 raft_consensus.cc:374] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.063647 1680 raft_consensus.cc:729] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.065660 1491 raft_consensus.cc:2454] T fc7f9957429a40e48f910aea5f43624f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
W20240501 20:12:12.065940 1457 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.100.2:35033, user_credentials={real_user=slave}} blocked reactor thread for 55583.1us
I20240501 20:12:12.066182 1604 leader_election.cc:302] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.058176 1555 tablet_service.cc:1467] Processing CreateTablet for tablet fd28f411966a432aa3a8cca7076c3ca7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 20:12:12.058849 1550 tablet_service.cc:1467] Processing CreateTablet for tablet c41682f6de504ad78a616818b19493bc (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 20:12:12.066713 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41682f6de504ad78a616818b19493bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.067410 1684 raft_consensus.cc:2781] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.067464 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.059505 1557 tablet_service.cc:1467] Processing CreateTablet for tablet e2f2a248c4924e539a7faea914ed64b7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 20:12:12.067812 1557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f2a248c4924e539a7faea914ed64b7. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 20:12:12.067873 1530 leader_election.cc:341] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.067842 1554 tablet_service.cc:1467] Processing CreateTablet for tablet c3c51e1cc64e4cc9bd2dc97403a28759 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 20:12:12.068483 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c51e1cc64e4cc9bd2dc97403a28759. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.068810 1681 ts_tablet_manager.cc:1398] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.175s user 0.015s sys 0.000s
I20240501 20:12:12.069069 1681 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.070315 1681 tablet_bootstrap.cc:654] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.072289 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 873087761cda482f8756584663220652 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 20:12:12.072707 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873087761cda482f8756584663220652. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.060016 1553 tablet_service.cc:1467] Processing CreateTablet for tablet 9fb7d6d5f5824535bd64f429ef8f0693 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 20:12:12.060081 1551 tablet_service.cc:1467] Processing CreateTablet for tablet 880cb9bb122a4337bb96b871a9cef339 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 20:12:12.073026 1557 tablet_service.cc:1467] Processing CreateTablet for tablet 29e32716adda49f9b25a5cad3ed195b9 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 20:12:12.073581 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fb7d6d5f5824535bd64f429ef8f0693. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.076359 1555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd28f411966a432aa3a8cca7076c3ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.081144 1551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 880cb9bb122a4337bb96b871a9cef339. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.084231 1550 tablet_service.cc:1467] Processing CreateTablet for tablet 38b9253ebcd94335aee17a5b039e712a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 20:12:12.060634 1549 tablet_service.cc:1467] Processing CreateTablet for tablet a961f26ce8d04b78a0e7d25fe8bbdfeb (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 20:12:12.059489 1548 tablet_service.cc:1467] Processing CreateTablet for tablet 4f37d944d0d844828f7d97eeac371d0a (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 20:12:12.061959 1556 tablet_service.cc:1467] Processing CreateTablet for tablet 6a46c25fb679479183f9803a9ad3c0c0 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 20:12:12.085731 1557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e32716adda49f9b25a5cad3ed195b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.060386 1688 tablet_bootstrap.cc:492] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.086604 1696 leader_election.cc:288] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.087738 1548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f37d944d0d844828f7d97eeac371d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.088307 1556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a46c25fb679479183f9803a9ad3c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.088671 1550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b9253ebcd94335aee17a5b039e712a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.091607 1549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a961f26ce8d04b78a0e7d25fe8bbdfeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.094902 1554 tablet_service.cc:1467] Processing CreateTablet for tablet d9178c194e31432eb382d89615c2c7d7 (DEFAULT_TABLE table=test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 20:12:12.095335 1554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9178c194e31432eb382d89615c2c7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:12.095224 1680 consensus_queue.cc:260] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.098176 1680 ts_tablet_manager.cc:1398] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20240501 20:12:12.098453 1680 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.104933 1680 tablet_bootstrap.cc:654] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.106827 1688 tablet_bootstrap.cc:654] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.108668 1684 raft_consensus.cc:686] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.110138 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc7f9957429a40e48f910aea5f43624f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.110184 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc7f9957429a40e48f910aea5f43624f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:12.110553 1606 leader_election.cc:341] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.111917 1684 consensus_queue.cc:237] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:12.113216 1699 raft_consensus.cc:482] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.113343 1699 raft_consensus.cc:504] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.114681 1699 leader_election.cc:288] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.116725 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.116870 1641 raft_consensus.cc:2454] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:12.117719 1532 leader_election.cc:302] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6
I20240501 20:12:12.118539 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f759565dcf84f43b14105cf6d3ca382" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:12.118957 1457 leader_election.cc:341] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.119139 1700 raft_consensus.cc:2781] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.119199 1700 raft_consensus.cc:482] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.119252 1700 raft_consensus.cc:3037] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.121320 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f759565dcf84f43b14105cf6d3ca382" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.121526 1681 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.121640 1681 ts_tablet_manager.cc:1367] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.053s user 0.020s sys 0.020s
W20240501 20:12:12.121816 1457 leader_election.cc:341] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.121899 1457 leader_election.cc:302] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.122090 1699 raft_consensus.cc:2726] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.126068 1681 raft_consensus.cc:348] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.126219 1681 raft_consensus.cc:374] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.126274 1681 raft_consensus.cc:729] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.126459 1681 consensus_queue.cc:260] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.127028 1681 ts_tablet_manager.cc:1398] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 20:12:12.127264 1681 tablet_bootstrap.cc:492] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.127100 1389 catalog_manager.cc:5484] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.137326 1700 raft_consensus.cc:504] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.140883 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.141103 1641 raft_consensus.cc:3037] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.140455 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
W20240501 20:12:12.141901 1530 leader_election.cc:341] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.142922 1700 leader_election.cc:288] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.150013 1641 raft_consensus.cc:2454] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.150466 1532 leader_election.cc:302] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6
I20240501 20:12:12.150745 1700 raft_consensus.cc:2781] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.151165 1700 raft_consensus.cc:686] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:12.151427 1700 consensus_queue.cc:237] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.151793 1681 tablet_bootstrap.cc:654] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.153460 1688 tablet_bootstrap.cc:492] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.153585 1688 ts_tablet_manager.cc:1367] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.004s
I20240501 20:12:12.153875 1680 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.153999 1680 ts_tablet_manager.cc:1367] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.010s
I20240501 20:12:12.154824 1680 raft_consensus.cc:348] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.154973 1680 raft_consensus.cc:374] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.155040 1680 raft_consensus.cc:729] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.155222 1680 consensus_queue.cc:260] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.155683 1680 ts_tablet_manager.cc:1398] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.155923 1680 tablet_bootstrap.cc:492] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.156212 1681 tablet_bootstrap.cc:492] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.156325 1681 ts_tablet_manager.cc:1367] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
I20240501 20:12:12.156957 1681 raft_consensus.cc:348] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.157138 1681 raft_consensus.cc:374] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.157191 1681 raft_consensus.cc:729] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.157425 1680 tablet_bootstrap.cc:654] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.157374 1681 consensus_queue.cc:260] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.157817 1688 raft_consensus.cc:348] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.158011 1688 raft_consensus.cc:374] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.158067 1688 raft_consensus.cc:729] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.158283 1688 consensus_queue.cc:260] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.158368 1681 ts_tablet_manager.cc:1398] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.158651 1681 tablet_bootstrap.cc:492] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.158715 1688 ts_tablet_manager.cc:1398] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 20:12:12.159497 1688 tablet_bootstrap.cc:492] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.159677 1390 catalog_manager.cc:5484] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.160926 1681 tablet_bootstrap.cc:654] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.160990 1688 tablet_bootstrap.cc:654] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.165071 1680 tablet_bootstrap.cc:492] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.165208 1680 ts_tablet_manager.cc:1367] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20240501 20:12:12.167953 1680 raft_consensus.cc:348] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.168151 1680 raft_consensus.cc:374] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.168216 1680 raft_consensus.cc:729] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.168407 1680 consensus_queue.cc:260] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.168562 1688 tablet_bootstrap.cc:492] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.168776 1680 ts_tablet_manager.cc:1398] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:12.169073 1680 tablet_bootstrap.cc:492] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.169106 1688 ts_tablet_manager.cc:1367] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.001s
I20240501 20:12:12.169854 1681 tablet_bootstrap.cc:492] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.169761 1688 raft_consensus.cc:348] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.170001 1688 raft_consensus.cc:374] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.170081 1688 raft_consensus.cc:729] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.170109 1681 ts_tablet_manager.cc:1367] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
W20240501 20:12:12.170390 1438 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 20:12:12.170296 1688 consensus_queue.cc:260] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.170754 1688 ts_tablet_manager.cc:1398] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 20:12:12.171073 1688 tablet_bootstrap.cc:492] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.170959 1681 raft_consensus.cc:348] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.171164 1681 raft_consensus.cc:374] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.171226 1681 raft_consensus.cc:729] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.171419 1681 consensus_queue.cc:260] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.171893 1681 ts_tablet_manager.cc:1398] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:12.172183 1681 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.172505 1688 tablet_bootstrap.cc:654] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.173609 1681 tablet_bootstrap.cc:654] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.174881 1680 tablet_bootstrap.cc:654] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.176767 1681 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.176893 1681 ts_tablet_manager.cc:1367] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 20:12:12.177527 1681 raft_consensus.cc:348] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.177704 1681 raft_consensus.cc:374] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.177776 1681 raft_consensus.cc:729] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.177971 1680 tablet_bootstrap.cc:492] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.177947 1681 consensus_queue.cc:260] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.178094 1680 ts_tablet_manager.cc:1367] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20240501 20:12:12.178365 1688 tablet_bootstrap.cc:492] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.178370 1681 ts_tablet_manager.cc:1398] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 20:12:12.178479 1688 ts_tablet_manager.cc:1367] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20240501 20:12:12.178660 1681 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.178635 1680 raft_consensus.cc:348] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.178773 1680 raft_consensus.cc:374] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.178820 1680 raft_consensus.cc:729] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.179019 1688 raft_consensus.cc:348] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.179059 1680 consensus_queue.cc:260] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.179159 1688 raft_consensus.cc:374] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.179205 1688 raft_consensus.cc:729] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.179358 1688 consensus_queue.cc:260] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.179828 1688 ts_tablet_manager.cc:1398] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:12.180055 1688 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.180202 1681 tablet_bootstrap.cc:654] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.180339 1680 ts_tablet_manager.cc:1398] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.180584 1680 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.181445 1688 tablet_bootstrap.cc:654] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.181988 1680 tablet_bootstrap.cc:654] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.186784 1680 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.186906 1680 ts_tablet_manager.cc:1367] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.002s
I20240501 20:12:12.187597 1680 raft_consensus.cc:348] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.187777 1680 raft_consensus.cc:374] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.187822 1680 raft_consensus.cc:729] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.188081 1680 consensus_queue.cc:260] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.188661 1680 ts_tablet_manager.cc:1398] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.188908 1680 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.189329 1681 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.189435 1681 ts_tablet_manager.cc:1367] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20240501 20:12:12.190621 1681 raft_consensus.cc:348] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.190801 1681 raft_consensus.cc:374] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.190853 1681 raft_consensus.cc:729] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.190965 1680 tablet_bootstrap.cc:654] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.191067 1681 consensus_queue.cc:260] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.192389 1681 ts_tablet_manager.cc:1398] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:12.192646 1681 tablet_bootstrap.cc:492] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.192827 1688 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.192929 1688 ts_tablet_manager.cc:1367] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.008s
I20240501 20:12:12.193315 1680 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.193446 1680 ts_tablet_manager.cc:1367] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 20:12:12.193614 1688 raft_consensus.cc:348] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.193771 1688 raft_consensus.cc:374] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.193825 1688 raft_consensus.cc:729] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.194018 1688 consensus_queue.cc:260] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.193989 1680 raft_consensus.cc:348] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.194572 1680 raft_consensus.cc:374] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.194604 1681 tablet_bootstrap.cc:654] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.194656 1680 raft_consensus.cc:729] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.194852 1680 consensus_queue.cc:260] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.195065 1688 ts_tablet_manager.cc:1398] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.195276 1688 tablet_bootstrap.cc:492] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.195395 1680 ts_tablet_manager.cc:1398] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.196034 1680 tablet_bootstrap.cc:492] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.196648 1688 tablet_bootstrap.cc:654] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.197396 1680 tablet_bootstrap.cc:654] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.202513 1681 tablet_bootstrap.cc:492] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.202630 1681 ts_tablet_manager.cc:1367] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20240501 20:12:12.203831 1681 raft_consensus.cc:348] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.204022 1681 raft_consensus.cc:374] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.204077 1681 raft_consensus.cc:729] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.204267 1681 consensus_queue.cc:260] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.204869 1681 ts_tablet_manager.cc:1398] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.205145 1681 tablet_bootstrap.cc:492] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.205271 1680 tablet_bootstrap.cc:492] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.205372 1688 tablet_bootstrap.cc:492] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.205471 1680 ts_tablet_manager.cc:1367] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20240501 20:12:12.205483 1688 ts_tablet_manager.cc:1367] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20240501 20:12:12.206243 1680 raft_consensus.cc:348] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.206334 1688 raft_consensus.cc:348] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:12.206506 1688 raft_consensus.cc:374] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.206480 1680 raft_consensus.cc:374] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.206585 1688 raft_consensus.cc:729] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.206710 1681 tablet_bootstrap.cc:654] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.206696 1680 raft_consensus.cc:729] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.206956 1688 consensus_queue.cc:260] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } }
I20240501 20:12:12.207044 1680 consensus_queue.cc:260] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.207444 1688 ts_tablet_manager.cc:1398] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.207721 1688 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.208343 1680 ts_tablet_manager.cc:1398] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 20:12:12.208636 1680 tablet_bootstrap.cc:492] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.209322 1688 tablet_bootstrap.cc:654] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.210351 1680 tablet_bootstrap.cc:654] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.216959 1681 tablet_bootstrap.cc:492] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.217113 1681 ts_tablet_manager.cc:1367] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.004s
I20240501 20:12:12.217461 1688 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.217578 1688 ts_tablet_manager.cc:1367] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20240501 20:12:12.217655 1681 raft_consensus.cc:348] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.217809 1681 raft_consensus.cc:374] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.217866 1681 raft_consensus.cc:729] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.218087 1681 consensus_queue.cc:260] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.218186 1688 raft_consensus.cc:348] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.218359 1688 raft_consensus.cc:374] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.218418 1688 raft_consensus.cc:729] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.218627 1681 ts_tablet_manager.cc:1398] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:12.218590 1688 consensus_queue.cc:260] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.218895 1681 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.219090 1680 tablet_bootstrap.cc:492] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.219237 1680 ts_tablet_manager.cc:1367] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240501 20:12:12.219846 1680 raft_consensus.cc:348] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.219995 1680 raft_consensus.cc:374] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.220052 1680 raft_consensus.cc:729] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.220242 1680 consensus_queue.cc:260] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.220345 1688 ts_tablet_manager.cc:1398] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:12.220371 1681 tablet_bootstrap.cc:654] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.220597 1688 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.220693 1680 ts_tablet_manager.cc:1398] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:12.221079 1680 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.222105 1688 tablet_bootstrap.cc:654] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.222697 1680 tablet_bootstrap.cc:654] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.226075 1680 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.226205 1680 ts_tablet_manager.cc:1367] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 20:12:12.226912 1680 raft_consensus.cc:348] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.227078 1680 raft_consensus.cc:374] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.227123 1680 raft_consensus.cc:729] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.227324 1680 consensus_queue.cc:260] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.227855 1680 ts_tablet_manager.cc:1398] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.228418 1680 tablet_bootstrap.cc:492] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.229995 1680 tablet_bootstrap.cc:654] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.232388 1681 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.232512 1681 ts_tablet_manager.cc:1367] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.007s
I20240501 20:12:12.232785 1688 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.232900 1688 ts_tablet_manager.cc:1367] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20240501 20:12:12.233244 1680 tablet_bootstrap.cc:492] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.233219 1681 raft_consensus.cc:348] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.233347 1680 ts_tablet_manager.cc:1367] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 20:12:12.233384 1681 raft_consensus.cc:374] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.233440 1681 raft_consensus.cc:729] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.233562 1688 raft_consensus.cc:348] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.233708 1688 raft_consensus.cc:374] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.233625 1681 consensus_queue.cc:260] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.233769 1688 raft_consensus.cc:729] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.233958 1688 consensus_queue.cc:260] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.233958 1680 raft_consensus.cc:348] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.234148 1680 raft_consensus.cc:374] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.234194 1681 ts_tablet_manager.cc:1398] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.234464 1681 tablet_bootstrap.cc:492] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.234505 1688 ts_tablet_manager.cc:1398] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:12:12.234510 1684 raft_consensus.cc:482] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.234730 1688 tablet_bootstrap.cc:492] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.234737 1684 raft_consensus.cc:504] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.235530 1684 leader_election.cc:288] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.236042 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04ba7f3ce10406fb8c299b54fa3299b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.236191 1688 tablet_bootstrap.cc:654] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.236222 1491 raft_consensus.cc:2454] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.236428 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04ba7f3ce10406fb8c299b54fa3299b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.236585 1604 leader_election.cc:302] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.236845 1684 raft_consensus.cc:2781] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20240501 20:12:12.236866 1606 leader_election.cc:341] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.236914 1684 raft_consensus.cc:482] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.236974 1684 raft_consensus.cc:3037] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.234194 1680 raft_consensus.cc:729] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.238330 1680 consensus_queue.cc:260] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.238926 1680 ts_tablet_manager.cc:1398] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 20:12:12.239147 1680 tablet_bootstrap.cc:492] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.239732 1684 raft_consensus.cc:504] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.240535 1680 tablet_bootstrap.cc:654] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.240585 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04ba7f3ce10406fb8c299b54fa3299b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.240725 1491 raft_consensus.cc:3037] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.241967 1700 raft_consensus.cc:482] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.242106 1700 raft_consensus.cc:504] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.242709 1700 leader_election.cc:288] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.243257 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c353b8338de4b3b9f7b3d0f268e5577" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.243420 1492 raft_consensus.cc:2454] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:12.243714 1491 raft_consensus.cc:2454] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.243745 1530 leader_election.cc:302] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.244016 1604 leader_election.cc:302] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.244282 1684 leader_election.cc:288] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.236028 1681 tablet_bootstrap.cc:654] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.244393 1704 raft_consensus.cc:2781] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.244518 1704 raft_consensus.cc:686] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.244824 1704 consensus_queue.cc:237] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.246085 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c353b8338de4b3b9f7b3d0f268e5577" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.246255 1641 raft_consensus.cc:2454] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:12.246490 1700 raft_consensus.cc:2781] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.246546 1700 raft_consensus.cc:482] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.246600 1700 raft_consensus.cc:3037] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.249899 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04ba7f3ce10406fb8c299b54fa3299b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:12.250439 1606 leader_election.cc:341] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.251546 1680 tablet_bootstrap.cc:492] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.251679 1680 ts_tablet_manager.cc:1367] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20240501 20:12:12.252280 1688 tablet_bootstrap.cc:492] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.252439 1688 ts_tablet_manager.cc:1367] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.013s
I20240501 20:12:12.252486 1680 raft_consensus.cc:348] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.252681 1680 raft_consensus.cc:374] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.252737 1680 raft_consensus.cc:729] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.252941 1680 consensus_queue.cc:260] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.253337 1688 raft_consensus.cc:348] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.253481 1680 ts_tablet_manager.cc:1398] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.253574 1688 raft_consensus.cc:374] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.253525 1700 raft_consensus.cc:504] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.253782 1680 tablet_bootstrap.cc:492] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.254245 1700 leader_election.cc:288] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.255159 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c353b8338de4b3b9f7b3d0f268e5577" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.255304 1491 raft_consensus.cc:3037] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.255434 1680 tablet_bootstrap.cc:654] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.257316 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c353b8338de4b3b9f7b3d0f268e5577" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.257459 1641 raft_consensus.cc:3037] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.257637 1681 tablet_bootstrap.cc:492] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.257771 1681 ts_tablet_manager.cc:1367] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.007s
I20240501 20:12:12.258477 1681 raft_consensus.cc:348] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.258704 1681 raft_consensus.cc:374] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.258759 1681 raft_consensus.cc:729] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.259039 1681 consensus_queue.cc:260] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.259788 1641 raft_consensus.cc:2454] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.260283 1681 ts_tablet_manager.cc:1398] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.260427 1532 leader_election.cc:302] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.260560 1681 tablet_bootstrap.cc:492] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.260663 1700 raft_consensus.cc:2781] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.260761 1700 raft_consensus.cc:686] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:12.260962 1700 consensus_queue.cc:237] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.262347 1681 tablet_bootstrap.cc:654] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.263175 1491 raft_consensus.cc:2454] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.264514 1680 tablet_bootstrap.cc:492] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.264420 1389 catalog_manager.cc:5484] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.264650 1680 ts_tablet_manager.cc:1367] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20240501 20:12:12.265386 1680 raft_consensus.cc:348] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.265578 1680 raft_consensus.cc:374] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.265635 1680 raft_consensus.cc:729] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.265866 1680 consensus_queue.cc:260] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.266425 1680 ts_tablet_manager.cc:1398] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.266681 1680 tablet_bootstrap.cc:492] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.267450 1681 tablet_bootstrap.cc:492] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.267568 1681 ts_tablet_manager.cc:1367] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20240501 20:12:12.268235 1681 raft_consensus.cc:348] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.268414 1681 raft_consensus.cc:374] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.268478 1681 raft_consensus.cc:729] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.268702 1681 consensus_queue.cc:260] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.268705 1688 raft_consensus.cc:729] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.269142 1688 consensus_queue.cc:260] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.269392 1681 ts_tablet_manager.cc:1398] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.269644 1681 tablet_bootstrap.cc:492] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.269793 1688 ts_tablet_manager.cc:1398] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
I20240501 20:12:12.270066 1688 tablet_bootstrap.cc:492] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.270954 1681 tablet_bootstrap.cc:654] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.271339 1688 tablet_bootstrap.cc:654] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.268589 1680 tablet_bootstrap.cc:654] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.274677 1681 tablet_bootstrap.cc:492] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.274807 1681 ts_tablet_manager.cc:1367] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240501 20:12:12.276661 1681 raft_consensus.cc:348] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.276846 1681 raft_consensus.cc:374] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.276901 1681 raft_consensus.cc:729] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.277168 1681 consensus_queue.cc:260] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.279945 1681 ts_tablet_manager.cc:1398] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 20:12:12.281113 1681 tablet_bootstrap.cc:492] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.282495 1681 tablet_bootstrap.cc:654] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.284317 1688 tablet_bootstrap.cc:492] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.284493 1688 ts_tablet_manager.cc:1367] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20240501 20:12:12.284615 1680 tablet_bootstrap.cc:492] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.284745 1680 ts_tablet_manager.cc:1367] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.005s
I20240501 20:12:12.285262 1688 raft_consensus.cc:348] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.285506 1688 raft_consensus.cc:374] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.285604 1688 raft_consensus.cc:729] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.285360 1680 raft_consensus.cc:348] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.285750 1680 raft_consensus.cc:374] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.285827 1680 raft_consensus.cc:729] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.286018 1688 consensus_queue.cc:260] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.286031 1680 consensus_queue.cc:260] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.286247 1699 raft_consensus.cc:482] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.286290 1681 tablet_bootstrap.cc:492] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.286388 1681 ts_tablet_manager.cc:1367] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 20:12:12.286347 1699 raft_consensus.cc:504] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.286746 1688 ts_tablet_manager.cc:1398] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.286886 1681 raft_consensus.cc:348] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.287161 1681 raft_consensus.cc:374] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.287222 1681 raft_consensus.cc:729] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.287379 1681 consensus_queue.cc:260] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.287472 1685 raft_consensus.cc:482] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.287511 1680 ts_tablet_manager.cc:1398] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:12.287585 1685 raft_consensus.cc:504] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.287741 1680 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.288426 1688 tablet_bootstrap.cc:492] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.289150 1680 tablet_bootstrap.cc:654] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.289676 1685 leader_election.cc:288] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.290199 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "206e6477b3ef4f9a90696dadebc33275" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.290365 1566 raft_consensus.cc:2454] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.286900 1699 leader_election.cc:288] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.290779 1688 tablet_bootstrap.cc:654] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.290932 1457 leader_election.cc:302] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.291308 1699 raft_consensus.cc:2781] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.291383 1699 raft_consensus.cc:482] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.291455 1699 raft_consensus.cc:3037] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.292774 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35fb57ac07c14ded9253288b2cf6b196" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.293089 1566 raft_consensus.cc:2454] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.294176 1681 ts_tablet_manager.cc:1398] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20240501 20:12:12.294485 1681 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.294544 1457 leader_election.cc:302] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.295794 1681 tablet_bootstrap.cc:654] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.296099 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35fb57ac07c14ded9253288b2cf6b196" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.296311 1640 raft_consensus.cc:2454] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.299383 1688 tablet_bootstrap.cc:492] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.299552 1688 ts_tablet_manager.cc:1367] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20240501 20:12:12.300189 1688 raft_consensus.cc:348] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.300426 1688 raft_consensus.cc:374] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.300527 1688 raft_consensus.cc:729] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.300791 1688 consensus_queue.cc:260] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.301162 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "206e6477b3ef4f9a90696dadebc33275" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.301319 1641 raft_consensus.cc:2454] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.301489 1688 ts_tablet_manager.cc:1398] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.301755 1688 tablet_bootstrap.cc:492] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.302385 1699 raft_consensus.cc:504] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.302969 1699 leader_election.cc:288] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.303122 1699 raft_consensus.cc:2781] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.303187 1699 raft_consensus.cc:482] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.303252 1699 raft_consensus.cc:3037] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.303395 1688 tablet_bootstrap.cc:654] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.305335 1681 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.305498 1681 ts_tablet_manager.cc:1367] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20240501 20:12:12.306099 1681 raft_consensus.cc:348] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.306268 1681 raft_consensus.cc:374] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.306317 1681 raft_consensus.cc:729] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.306545 1681 consensus_queue.cc:260] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.306998 1681 ts_tablet_manager.cc:1398] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 20:12:12.306963 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "206e6477b3ef4f9a90696dadebc33275" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.307108 1566 raft_consensus.cc:3037] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.307206 1681 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.308426 1681 tablet_bootstrap.cc:654] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.309943 1566 raft_consensus.cc:2454] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.310865 1457 leader_election.cc:302] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.311118 1685 raft_consensus.cc:2781] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.311205 1685 raft_consensus.cc:686] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.311444 1685 consensus_queue.cc:237] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.312160 1688 tablet_bootstrap.cc:492] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.312279 1688 ts_tablet_manager.cc:1367] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.002s
I20240501 20:12:12.312886 1688 raft_consensus.cc:348] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.313076 1688 raft_consensus.cc:374] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.313139 1688 raft_consensus.cc:729] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.313212 1704 raft_consensus.cc:482] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.313305 1704 raft_consensus.cc:504] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.313510 1681 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.313671 1681 ts_tablet_manager.cc:1367] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240501 20:12:12.313745 1704 leader_election.cc:288] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.314069 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bf896d96b341a9bc7125b68797a9b2" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.314204 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "206e6477b3ef4f9a90696dadebc33275" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.314319 1641 raft_consensus.cc:3037] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:12:12.314486 1604 leader_election.cc:341] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.314409 1681 raft_consensus.cc:348] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.314585 1681 raft_consensus.cc:374] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.314632 1681 raft_consensus.cc:729] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.314846 1681 consensus_queue.cc:260] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.316107 1641 raft_consensus.cc:2454] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.317019 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bf896d96b341a9bc7125b68797a9b2" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.318557 1699 raft_consensus.cc:504] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
W20240501 20:12:12.319136 1606 leader_election.cc:341] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.319608 1606 leader_election.cc:302] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.319885 1704 raft_consensus.cc:2726] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.320545 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35fb57ac07c14ded9253288b2cf6b196" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.320699 1641 raft_consensus.cc:3037] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.322129 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35fb57ac07c14ded9253288b2cf6b196" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.322284 1566 raft_consensus.cc:3037] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.323207 1641 raft_consensus.cc:2454] T 35fb57ac07c14ded9253288b2cf6b196 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.323524 1457 leader_election.cc:302] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.323820 1752 raft_consensus.cc:2781] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.323949 1752 raft_consensus.cc:686] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.324208 1752 consensus_queue.cc:237] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.324693 1566 raft_consensus.cc:2454] T 35fb57ac07c14ded9253288b2cf6b196 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.319187 1699 leader_election.cc:288] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.319216 1681 ts_tablet_manager.cc:1398] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20240501 20:12:12.325855 1681 tablet_bootstrap.cc:492] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.326056 1698 raft_consensus.cc:482] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.326162 1698 raft_consensus.cc:504] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.326665 1698 leader_election.cc:288] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.313311 1688 consensus_queue.cc:260] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.326608 1389 catalog_manager.cc:5484] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.327260 1688 ts_tablet_manager.cc:1398] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20240501 20:12:12.327514 1688 tablet_bootstrap.cc:492] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.327572 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704a5fa4f8fa467b935ebe6c1bdf79a3" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.327785 1491 raft_consensus.cc:2454] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:12.328749 1688 tablet_bootstrap.cc:654] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.328830 1530 leader_election.cc:302] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.329102 1698 raft_consensus.cc:2781] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.329175 1698 raft_consensus.cc:482] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.329229 1698 raft_consensus.cc:3037] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.329671 1681 tablet_bootstrap.cc:654] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.331904 1698 raft_consensus.cc:504] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.332859 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704a5fa4f8fa467b935ebe6c1bdf79a3" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.332993 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704a5fa4f8fa467b935ebe6c1bdf79a3" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.333174 1640 raft_consensus.cc:3037] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.333249 1681 tablet_bootstrap.cc:492] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.333117 1491 raft_consensus.cc:3037] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.335675 1640 raft_consensus.cc:2454] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.335763 1681 ts_tablet_manager.cc:1367] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20240501 20:12:12.335675 1491 raft_consensus.cc:2454] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.336074 1684 raft_consensus.cc:482] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.336130 1532 leader_election.cc:302] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.336179 1684 raft_consensus.cc:504] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.336441 1704 raft_consensus.cc:482] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.336537 1704 raft_consensus.cc:504] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.336684 1684 leader_election.cc:288] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.336706 1681 raft_consensus.cc:348] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.336867 1681 raft_consensus.cc:374] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.336920 1681 raft_consensus.cc:729] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.337025 1704 leader_election.cc:288] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.337538 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca56ce912074ec987a2d52e271e8c39" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.337666 1698 leader_election.cc:288] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.337697 1492 raft_consensus.cc:2454] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.337778 1698 raft_consensus.cc:2781] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.337853 1698 raft_consensus.cc:686] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:12.337826 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca56ce912074ec987a2d52e271e8c39" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.337983 1567 raft_consensus.cc:2454] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.338106 1604 leader_election.cc:302] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.338063 1698 consensus_queue.cc:237] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.338485 1704 raft_consensus.cc:2781] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.338563 1704 raft_consensus.cc:482] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.338631 1704 raft_consensus.cc:3037] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.332062 1688 tablet_bootstrap.cc:492] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.340854 1688 ts_tablet_manager.cc:1367] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20240501 20:12:12.341185 1699 raft_consensus.cc:482] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.341156 1704 raft_consensus.cc:504] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.341357 1699 raft_consensus.cc:504] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.341459 1688 raft_consensus.cc:348] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.341636 1688 raft_consensus.cc:374] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.341697 1688 raft_consensus.cc:729] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.341892 1688 consensus_queue.cc:260] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.342018 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca56ce912074ec987a2d52e271e8c39" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.342132 1492 raft_consensus.cc:3037] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.342366 1688 ts_tablet_manager.cc:1398] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 20:12:12.342624 1699 leader_election.cc:288] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.342674 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca56ce912074ec987a2d52e271e8c39" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.342846 1640 raft_consensus.cc:2379] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:12.342981 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "704a5fa4f8fa467b935ebe6c1bdf79a3" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.343154 1641 raft_consensus.cc:2362] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1. Re-sending same reply.
I20240501 20:12:12.344512 1492 raft_consensus.cc:2454] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.344874 1680 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.344907 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca56ce912074ec987a2d52e271e8c39" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.344983 1680 ts_tablet_manager.cc:1367] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.057s user 0.011s sys 0.026s
I20240501 20:12:12.344789 1389 catalog_manager.cc:5484] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.345037 1567 raft_consensus.cc:2454] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.345588 1680 raft_consensus.cc:348] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.345628 1604 leader_election.cc:302] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.341370 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9d9af841834c8bac7406a2dbad0b55" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.345741 1457 leader_election.cc:302] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters: e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:12.345870 1684 raft_consensus.cc:2781] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.345975 1684 raft_consensus.cc:686] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.346180 1684 consensus_queue.cc:237] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.346293 1566 raft_consensus.cc:2454] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.346673 1704 leader_election.cc:288] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.346817 1745 raft_consensus.cc:2741] T aca56ce912074ec987a2d52e271e8c39 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20240501 20:12:12.347023 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9d9af841834c8bac7406a2dbad0b55" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.337121 1681 consensus_queue.cc:260] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.347891 1681 ts_tablet_manager.cc:1398] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20240501 20:12:12.347654 1390 catalog_manager.cc:5484] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.348129 1681 tablet_bootstrap.cc:492] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.348213 1606 leader_election.cc:302] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.348601 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca56ce912074ec987a2d52e271e8c39" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.348737 1566 raft_consensus.cc:3037] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:12:12.348706 1604 leader_election.cc:341] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.349467 1704 raft_consensus.cc:2781] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.349539 1704 raft_consensus.cc:482] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.349592 1704 raft_consensus.cc:3037] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.351341 1566 raft_consensus.cc:2454] T aca56ce912074ec987a2d52e271e8c39 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.351898 1704 raft_consensus.cc:504] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.345849 1680 raft_consensus.cc:374] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.352559 1680 raft_consensus.cc:729] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.352761 1680 consensus_queue.cc:260] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.353420 1680 ts_tablet_manager.cc:1398] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240501 20:12:12.353722 1680 tablet_bootstrap.cc:492] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.353623 1390 catalog_manager.cc:5484] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.354343 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9d9af841834c8bac7406a2dbad0b55" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
W20240501 20:12:12.354760 1604 leader_election.cc:341] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.355333 1704 leader_election.cc:288] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.355546 1688 tablet_bootstrap.cc:492] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.355738 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9d9af841834c8bac7406a2dbad0b55" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.355916 1567 raft_consensus.cc:3037] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.356724 1688 tablet_bootstrap.cc:654] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.357132 1680 tablet_bootstrap.cc:654] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.358192 1567 raft_consensus.cc:2454] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.358634 1606 leader_election.cc:302] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6
I20240501 20:12:12.360060 1389 catalog_manager.cc:5484] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.360657 1681 tablet_bootstrap.cc:654] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.366616 1684 raft_consensus.cc:2781] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.367103 1684 raft_consensus.cc:686] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.368090 1684 consensus_queue.cc:237] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.373652 1389 catalog_manager.cc:5484] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.378305 1688 tablet_bootstrap.cc:492] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.378469 1688 ts_tablet_manager.cc:1367] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.009s
I20240501 20:12:12.378787 1680 tablet_bootstrap.cc:492] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.378952 1680 ts_tablet_manager.cc:1367] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.016s
I20240501 20:12:12.379155 1681 tablet_bootstrap.cc:492] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.379321 1681 ts_tablet_manager.cc:1367] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.031s user 0.019s sys 0.000s
I20240501 20:12:12.379226 1688 raft_consensus.cc:348] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.379413 1688 raft_consensus.cc:374] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.379527 1688 raft_consensus.cc:729] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.379616 1680 raft_consensus.cc:348] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.379832 1680 raft_consensus.cc:374] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.379760 1688 consensus_queue.cc:260] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.379906 1680 raft_consensus.cc:729] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.380653 1688 ts_tablet_manager.cc:1398] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:12.380602 1681 raft_consensus.cc:348] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.380607 1680 consensus_queue.cc:260] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.380836 1681 raft_consensus.cc:374] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.380918 1681 raft_consensus.cc:729] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.381026 1688 tablet_bootstrap.cc:492] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.381186 1681 consensus_queue.cc:260] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.381696 1681 ts_tablet_manager.cc:1398] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.381861 1680 ts_tablet_manager.cc:1398] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:12:12.382050 1681 tablet_bootstrap.cc:492] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.382141 1680 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.386086 1680 tablet_bootstrap.cc:654] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.386333 1681 tablet_bootstrap.cc:654] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.383064 1688 tablet_bootstrap.cc:654] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.388298 1681 tablet_bootstrap.cc:492] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.388458 1681 ts_tablet_manager.cc:1367] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20240501 20:12:12.389101 1688 tablet_bootstrap.cc:492] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.389113 1680 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.389147 1681 raft_consensus.cc:348] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.389278 1688 ts_tablet_manager.cc:1367] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20240501 20:12:12.389335 1681 raft_consensus.cc:374] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.389412 1681 raft_consensus.cc:729] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.389453 1680 ts_tablet_manager.cc:1367] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20240501 20:12:12.389601 1681 consensus_queue.cc:260] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.389992 1681 ts_tablet_manager.cc:1398] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 20:12:12.389969 1688 raft_consensus.cc:348] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.390183 1688 raft_consensus.cc:374] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.390265 1688 raft_consensus.cc:729] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.390295 1681 tablet_bootstrap.cc:492] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.390475 1688 consensus_queue.cc:260] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.390959 1688 ts_tablet_manager.cc:1398] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:12.391242 1688 tablet_bootstrap.cc:492] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.391191 1680 raft_consensus.cc:348] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.391467 1680 raft_consensus.cc:374] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.391602 1680 raft_consensus.cc:729] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.391798 1681 tablet_bootstrap.cc:654] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.391934 1680 consensus_queue.cc:260] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.392925 1688 tablet_bootstrap.cc:654] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.393368 1680 ts_tablet_manager.cc:1398] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20240501 20:12:12.393695 1680 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.396176 1680 tablet_bootstrap.cc:654] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.400445 1684 raft_consensus.cc:482] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.400733 1688 tablet_bootstrap.cc:492] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.400605 1684 raft_consensus.cc:504] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.401288 1684 leader_election.cc:288] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.401309 1752 raft_consensus.cc:482] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.401497 1752 raft_consensus.cc:504] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.401754 1681 tablet_bootstrap.cc:492] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.401921 1681 ts_tablet_manager.cc:1367] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20240501 20:12:12.401964 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a197f73ccd5f41038acbd61a5a631c79" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.402112 1752 leader_election.cc:288] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.402200 1491 raft_consensus.cc:2454] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.402493 1756 raft_consensus.cc:482] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.402614 1604 leader_election.cc:302] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.402745 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a197f73ccd5f41038acbd61a5a631c79" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.402925 1566 raft_consensus.cc:2454] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.402635 1756 raft_consensus.cc:504] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.403016 1681 raft_consensus.cc:348] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.403214 1681 raft_consensus.cc:374] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.403303 1681 raft_consensus.cc:729] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.403489 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1c73dc1c684af1a5792ad2ab6e3fff" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.403576 1756 leader_election.cc:288] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.403544 1681 consensus_queue.cc:260] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.403705 1641 raft_consensus.cc:2454] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.404065 1681 ts_tablet_manager.cc:1398] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.404071 1684 raft_consensus.cc:2781] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.404206 1684 raft_consensus.cc:482] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.404320 1684 raft_consensus.cc:3037] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.404429 1457 leader_election.cc:302] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.404736 1745 raft_consensus.cc:2781] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.404860 1745 raft_consensus.cc:482] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.404963 1745 raft_consensus.cc:3037] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.405004 1681 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.406733 1681 tablet_bootstrap.cc:654] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.407229 1684 raft_consensus.cc:504] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.407725 1745 raft_consensus.cc:504] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.408179 1684 leader_election.cc:288] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.408402 1688 ts_tablet_manager.cc:1367] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.009s
I20240501 20:12:12.408444 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a197f73ccd5f41038acbd61a5a631c79" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.408660 1567 raft_consensus.cc:3037] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.409274 1688 raft_consensus.cc:348] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.409482 1688 raft_consensus.cc:374] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.409569 1688 raft_consensus.cc:729] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.409637 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68951f3197141fabb5828e9e87545a8" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.409868 1492 raft_consensus.cc:2454] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:12.409795 1688 consensus_queue.cc:260] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.410312 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68951f3197141fabb5828e9e87545a8" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.410517 1641 raft_consensus.cc:2454] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:12.412134 1745 leader_election.cc:288] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.412431 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1c73dc1c684af1a5792ad2ab6e3fff" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.412650 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a197f73ccd5f41038acbd61a5a631c79" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.416126 1491 raft_consensus.cc:3037] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.416102 1566 raft_consensus.cc:2454] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.416620 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1c73dc1c684af1a5792ad2ab6e3fff" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.416815 1641 raft_consensus.cc:3037] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.412899 1688 ts_tablet_manager.cc:1398] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:12:12.413033 1530 leader_election.cc:302] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.417322 1756 raft_consensus.cc:2781] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.417433 1756 raft_consensus.cc:482] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.417526 1756 raft_consensus.cc:3037] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.418644 1491 raft_consensus.cc:2454] T a197f73ccd5f41038acbd61a5a631c79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.418946 1641 raft_consensus.cc:2454] T dc1c73dc1c684af1a5792ad2ab6e3fff P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.419474 1604 leader_election.cc:302] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.419716 1684 raft_consensus.cc:2781] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.419708 1756 raft_consensus.cc:504] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.419914 1684 raft_consensus.cc:686] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.420243 1756 leader_election.cc:288] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.420184 1684 consensus_queue.cc:237] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.413652 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1c73dc1c684af1a5792ad2ab6e3fff" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.420433 1565 raft_consensus.cc:3037] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.420630 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68951f3197141fabb5828e9e87545a8" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.420805 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68951f3197141fabb5828e9e87545a8" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.415169 1681 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.415884 1567 raft_consensus.cc:2454] T a197f73ccd5f41038acbd61a5a631c79 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.421118 1491 raft_consensus.cc:3037] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.420863 1641 raft_consensus.cc:3037] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.423229 1565 raft_consensus.cc:2454] T dc1c73dc1c684af1a5792ad2ab6e3fff P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.423489 1752 raft_consensus.cc:482] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.423632 1752 raft_consensus.cc:504] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.424088 1641 raft_consensus.cc:2454] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.424177 1752 leader_election.cc:288] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.423648 1457 leader_election.cc:302] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.424461 1681 ts_tablet_manager.cc:1367] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.001s
I20240501 20:12:12.424489 1532 leader_election.cc:302] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.424883 1756 raft_consensus.cc:2781] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.425071 1752 raft_consensus.cc:2781] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.425102 1756 raft_consensus.cc:686] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:12.425220 1752 raft_consensus.cc:686] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.425251 1681 raft_consensus.cc:348] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.425443 1681 raft_consensus.cc:374] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.425354 1756 consensus_queue.cc:237] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.425419 1752 consensus_queue.cc:237] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.425545 1681 raft_consensus.cc:729] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.425752 1681 consensus_queue.cc:260] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.426270 1681 ts_tablet_manager.cc:1398] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.413951 1680 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.426538 1688 tablet_bootstrap.cc:492] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.426543 1680 ts_tablet_manager.cc:1367] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.016s
I20240501 20:12:12.427040 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c4f81d151c4ed5ac6b7ecba2803d08" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.427271 1680 raft_consensus.cc:348] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.427479 1680 raft_consensus.cc:374] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20240501 20:12:12.427500 1457 leader_election.cc:341] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.427584 1680 raft_consensus.cc:729] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.427754 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c4f81d151c4ed5ac6b7ecba2803d08" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.427843 1680 consensus_queue.cc:260] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.427937 1491 raft_consensus.cc:2454] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.426549 1681 tablet_bootstrap.cc:492] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
W20240501 20:12:12.428725 1457 leader_election.cc:341] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.428895 1457 leader_election.cc:302] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.429370 1680 ts_tablet_manager.cc:1398] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:12:12.429708 1688 tablet_bootstrap.cc:654] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.429740 1745 raft_consensus.cc:2726] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.430253 1680 tablet_bootstrap.cc:492] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.430485 1681 tablet_bootstrap.cc:654] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.432101 1680 tablet_bootstrap.cc:654] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.439790 1688 tablet_bootstrap.cc:492] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.440488 1752 raft_consensus.cc:482] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.440788 1390 catalog_manager.cc:5484] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.441181 1752 raft_consensus.cc:504] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.441995 1752 leader_election.cc:288] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.440951 1680 tablet_bootstrap.cc:492] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.442297 1680 ts_tablet_manager.cc:1367] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.003s
I20240501 20:12:12.442991 1680 raft_consensus.cc:348] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.443141 1680 raft_consensus.cc:374] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.443240 1680 raft_consensus.cc:729] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.443452 1680 consensus_queue.cc:260] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.443928 1680 ts_tablet_manager.cc:1398] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 20:12:12.444168 1680 tablet_bootstrap.cc:492] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.445436 1680 tablet_bootstrap.cc:654] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.445878 1389 catalog_manager.cc:5484] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.446630 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259e5b9c72f84518b1269ce8688ef32f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.446964 1688 ts_tablet_manager.cc:1367] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.003s
I20240501 20:12:12.447196 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259e5b9c72f84518b1269ce8688ef32f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.447392 1641 raft_consensus.cc:2454] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.447680 1688 raft_consensus.cc:348] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.447880 1688 raft_consensus.cc:374] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.447955 1688 raft_consensus.cc:729] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.448031 1457 leader_election.cc:302] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
W20240501 20:12:12.448328 1457 leader_election.cc:341] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.448652 1752 raft_consensus.cc:2781] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.448781 1752 raft_consensus.cc:482] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.448881 1752 raft_consensus.cc:3037] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.448963 1688 consensus_queue.cc:260] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.449479 1688 ts_tablet_manager.cc:1398] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.449755 1688 tablet_bootstrap.cc:492] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.451220 1688 tablet_bootstrap.cc:654] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.452008 1752 raft_consensus.cc:504] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.452967 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259e5b9c72f84518b1269ce8688ef32f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:12.453564 1457 leader_election.cc:341] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.454299 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259e5b9c72f84518b1269ce8688ef32f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.454484 1641 raft_consensus.cc:3037] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.455614 1680 tablet_bootstrap.cc:492] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.455794 1680 ts_tablet_manager.cc:1367] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20240501 20:12:12.456609 1680 raft_consensus.cc:348] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.456832 1680 raft_consensus.cc:374] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.456905 1680 raft_consensus.cc:729] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.457187 1680 consensus_queue.cc:260] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.457757 1641 raft_consensus.cc:2454] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.458178 1457 leader_election.cc:302] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.458206 1752 leader_election.cc:288] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.457813 1680 ts_tablet_manager.cc:1398] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.458446 1745 raft_consensus.cc:2781] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.458632 1680 tablet_bootstrap.cc:492] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.458607 1745 raft_consensus.cc:686] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.458842 1745 consensus_queue.cc:237] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.459815 1704 raft_consensus.cc:482] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.459956 1704 raft_consensus.cc:504] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.460116 1680 tablet_bootstrap.cc:654] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.460575 1704 leader_election.cc:288] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.461488 1389 catalog_manager.cc:5484] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.462818 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "500fba598d2e4c858888998c3e3d2080" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.463037 1491 raft_consensus.cc:2454] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.463440 1604 leader_election.cc:302] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.463704 1704 raft_consensus.cc:2781] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.463809 1704 raft_consensus.cc:482] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.463891 1704 raft_consensus.cc:3037] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.465204 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "500fba598d2e4c858888998c3e3d2080" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:12.465688 1606 leader_election.cc:341] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.467886 1699 raft_consensus.cc:482] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.468073 1699 raft_consensus.cc:504] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.468663 1699 leader_election.cc:288] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.469213 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb27ad1cad004e74896f221012308e97" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.469425 1565 raft_consensus.cc:2454] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.467465 1704 raft_consensus.cc:504] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.470125 1457 leader_election.cc:302] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.470763 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb27ad1cad004e74896f221012308e97" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.470952 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "500fba598d2e4c858888998c3e3d2080" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.471035 1641 raft_consensus.cc:2454] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.471179 1491 raft_consensus.cc:3037] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.473361 1681 tablet_bootstrap.cc:492] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.473524 1681 ts_tablet_manager.cc:1367] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.047s user 0.013s sys 0.027s
I20240501 20:12:12.473824 1680 tablet_bootstrap.cc:492] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.473973 1680 ts_tablet_manager.cc:1367] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.012s
I20240501 20:12:12.473976 1491 raft_consensus.cc:2454] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.474198 1704 leader_election.cc:288] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.474380 1699 raft_consensus.cc:2781] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.474488 1604 leader_election.cc:302] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.474630 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "500fba598d2e4c858888998c3e3d2080" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.474489 1699 raft_consensus.cc:482] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.474794 1699 raft_consensus.cc:3037] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.474820 1704 raft_consensus.cc:2781] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.474726 1680 raft_consensus.cc:348] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.474928 1680 raft_consensus.cc:374] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.475010 1680 raft_consensus.cc:729] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
W20240501 20:12:12.475097 1606 leader_election.cc:341] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.475229 1704 raft_consensus.cc:686] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.475225 1680 consensus_queue.cc:260] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.475601 1704 consensus_queue.cc:237] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.475816 1680 ts_tablet_manager.cc:1398] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.476090 1680 tablet_bootstrap.cc:492] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.476898 1699 raft_consensus.cc:504] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.477166 1688 tablet_bootstrap.cc:492] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.477294 1688 ts_tablet_manager.cc:1367] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.006s
I20240501 20:12:12.477460 1699 leader_election.cc:288] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.477650 1680 tablet_bootstrap.cc:654] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.477918 1681 raft_consensus.cc:348] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.478006 1688 raft_consensus.cc:348] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.478134 1681 raft_consensus.cc:374] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.478192 1688 raft_consensus.cc:374] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.478225 1681 raft_consensus.cc:729] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.478291 1688 raft_consensus.cc:729] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.478457 1681 consensus_queue.cc:260] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.478416 1389 catalog_manager.cc:5484] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.479010 1681 ts_tablet_manager.cc:1398] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 20:12:12.479290 1681 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.479460 1688 consensus_queue.cc:260] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.480675 1681 tablet_bootstrap.cc:654] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.481570 1688 ts_tablet_manager.cc:1398] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:12:12.481863 1688 tablet_bootstrap.cc:492] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.483407 1688 tablet_bootstrap.cc:654] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.486797 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb27ad1cad004e74896f221012308e97" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.487005 1565 raft_consensus.cc:3037] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.489398 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb27ad1cad004e74896f221012308e97" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.489804 1641 raft_consensus.cc:3037] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.492697 1641 raft_consensus.cc:2454] T fb27ad1cad004e74896f221012308e97 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.493113 1457 leader_election.cc:302] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.493427 1699 raft_consensus.cc:2781] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.494585 1699 raft_consensus.cc:686] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.497169 1699 consensus_queue.cc:237] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.498613 1390 catalog_manager.cc:5484] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.498920 1680 tablet_bootstrap.cc:492] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.499078 1680 ts_tablet_manager.cc:1367] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.016s
I20240501 20:12:12.499373 1681 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.499503 1681 ts_tablet_manager.cc:1367] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.012s
I20240501 20:12:12.499775 1680 raft_consensus.cc:348] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.499967 1680 raft_consensus.cc:374] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.500046 1680 raft_consensus.cc:729] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.500192 1565 raft_consensus.cc:2454] T fb27ad1cad004e74896f221012308e97 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.500169 1681 raft_consensus.cc:348] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.500273 1680 consensus_queue.cc:260] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.500392 1681 raft_consensus.cc:374] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.500485 1681 raft_consensus.cc:729] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.500679 1681 consensus_queue.cc:260] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.500787 1680 ts_tablet_manager.cc:1398] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.501027 1680 tablet_bootstrap.cc:492] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.501296 1681 ts_tablet_manager.cc:1398] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.501564 1681 tablet_bootstrap.cc:492] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.502754 1680 tablet_bootstrap.cc:654] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.503129 1681 tablet_bootstrap.cc:654] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.513581 1699 raft_consensus.cc:482] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.513758 1699 raft_consensus.cc:504] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.514367 1699 leader_election.cc:288] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.514739 1390 catalog_manager.cc:5484] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.515487 1680 tablet_bootstrap.cc:492] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.515635 1680 ts_tablet_manager.cc:1367] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.006s
I20240501 20:12:12.516315 1680 raft_consensus.cc:348] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.516507 1680 raft_consensus.cc:374] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.516616 1680 raft_consensus.cc:729] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.516866 1680 consensus_queue.cc:260] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.517412 1680 ts_tablet_manager.cc:1398] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.517706 1680 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.517903 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e369ffe23d6b4eb58c8031d82cc89e3b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.518101 1641 raft_consensus.cc:2454] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.518675 1457 leader_election.cc:302] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.519193 1680 tablet_bootstrap.cc:654] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.520018 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e369ffe23d6b4eb58c8031d82cc89e3b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.520228 1565 raft_consensus.cc:2454] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.521000 1699 raft_consensus.cc:2781] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.521122 1699 raft_consensus.cc:482] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.521240 1699 raft_consensus.cc:3037] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.521765 1681 tablet_bootstrap.cc:492] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.521934 1681 ts_tablet_manager.cc:1367] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.012s
I20240501 20:12:12.522624 1681 raft_consensus.cc:348] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.522838 1681 raft_consensus.cc:374] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.522919 1681 raft_consensus.cc:729] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.523182 1681 consensus_queue.cc:260] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.523782 1681 ts_tablet_manager.cc:1398] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.524081 1681 tablet_bootstrap.cc:492] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.524147 1699 raft_consensus.cc:504] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.524806 1699 leader_election.cc:288] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.525593 1681 tablet_bootstrap.cc:654] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.526139 1688 tablet_bootstrap.cc:492] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.526340 1688 ts_tablet_manager.cc:1367] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.045s user 0.012s sys 0.008s
I20240501 20:12:12.526479 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e369ffe23d6b4eb58c8031d82cc89e3b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.526681 1641 raft_consensus.cc:3037] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.527293 1688 raft_consensus.cc:348] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.527663 1688 raft_consensus.cc:374] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.527798 1688 raft_consensus.cc:729] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.528707 1688 consensus_queue.cc:260] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.530957 1688 ts_tablet_manager.cc:1398] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:12.531318 1688 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.532116 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e369ffe23d6b4eb58c8031d82cc89e3b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.534667 1565 raft_consensus.cc:3037] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.533463 1641 raft_consensus.cc:2454] T e369ffe23d6b4eb58c8031d82cc89e3b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.534824 1680 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.534981 1680 ts_tablet_manager.cc:1367] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.009s
I20240501 20:12:12.535171 1457 leader_election.cc:302] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.535225 1681 tablet_bootstrap.cc:492] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.535354 1681 ts_tablet_manager.cc:1367] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20240501 20:12:12.535436 1699 raft_consensus.cc:2781] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.534377 1567 raft_consensus.cc:3037] T fc7f9957429a40e48f910aea5f43624f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.535861 1699 raft_consensus.cc:686] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.536139 1699 consensus_queue.cc:237] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.537356 1688 tablet_bootstrap.cc:654] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.537560 1565 raft_consensus.cc:2454] T e369ffe23d6b4eb58c8031d82cc89e3b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.535858 1680 raft_consensus.cc:348] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.538848 1680 raft_consensus.cc:374] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.538924 1680 raft_consensus.cc:729] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.539170 1680 consensus_queue.cc:260] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.539340 1704 consensus_queue.cc:1035] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.539734 1680 ts_tablet_manager.cc:1398] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 20:12:12.540005 1680 tablet_bootstrap.cc:492] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.539647 1681 raft_consensus.cc:348] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.541440 1688 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.541570 1688 ts_tablet_manager.cc:1367] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20240501 20:12:12.542086 1680 tablet_bootstrap.cc:654] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.542263 1688 raft_consensus.cc:348] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.542464 1688 raft_consensus.cc:374] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.542557 1688 raft_consensus.cc:729] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.542860 1688 consensus_queue.cc:260] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.543411 1688 ts_tablet_manager.cc:1398] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.543644 1688 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.544062 1680 tablet_bootstrap.cc:492] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.544193 1680 ts_tablet_manager.cc:1367] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240501 20:12:12.544845 1680 raft_consensus.cc:348] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.545037 1680 raft_consensus.cc:374] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.545073 1688 tablet_bootstrap.cc:654] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.545156 1681 raft_consensus.cc:374] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.545197 1680 raft_consensus.cc:729] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.545233 1704 raft_consensus.cc:482] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.545260 1681 raft_consensus.cc:729] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.545368 1704 raft_consensus.cc:504] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.545413 1680 consensus_queue.cc:260] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.545441 1681 consensus_queue.cc:260] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.545930 1681 ts_tablet_manager.cc:1398] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20240501 20:12:12.545969 1704 leader_election.cc:288] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.545935 1680 ts_tablet_manager.cc:1398] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.546182 1681 tablet_bootstrap.cc:492] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.546228 1680 tablet_bootstrap.cc:492] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.546569 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c88aa6fcedc6495ba20b1e5a5a59a554" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.546720 1491 raft_consensus.cc:2454] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.547169 1604 leader_election.cc:302] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.547365 1684 raft_consensus.cc:482] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.547448 1684 raft_consensus.cc:504] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.547623 1696 raft_consensus.cc:2781] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.547693 1696 raft_consensus.cc:482] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.547731 1696 raft_consensus.cc:3037] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.547925 1684 leader_election.cc:288] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.548022 1684 raft_consensus.cc:482] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.548100 1684 raft_consensus.cc:504] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.548199 1680 tablet_bootstrap.cc:654] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.548904 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f759565dcf84f43b14105cf6d3ca382" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.549067 1491 raft_consensus.cc:2454] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.549688 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c88aa6fcedc6495ba20b1e5a5a59a554" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.549793 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f759565dcf84f43b14105cf6d3ca382" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.549934 1566 raft_consensus.cc:2454] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.550673 1604 leader_election.cc:302] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.550854 1704 raft_consensus.cc:2781] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.550945 1704 raft_consensus.cc:482] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20240501 20:12:12.550969 1606 leader_election.cc:341] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.551029 1704 raft_consensus.cc:3037] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.550998 1389 catalog_manager.cc:5484] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.553215 1704 raft_consensus.cc:504] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.553617 1684 leader_election.cc:288] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.553777 1699 raft_consensus.cc:482] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.553859 1699 raft_consensus.cc:504] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.554279 1699 leader_election.cc:288] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.554772 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.550963 1696 raft_consensus.cc:504] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.555442 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e390a9bcddb34c7eb4d9f91a0a889a5d" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.555599 1566 raft_consensus.cc:2454] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.555893 1696 leader_election.cc:288] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.555933 1606 leader_election.cc:302] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.556161 1696 raft_consensus.cc:2781] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.556198 1681 tablet_bootstrap.cc:654] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.556247 1696 raft_consensus.cc:482] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.556305 1696 raft_consensus.cc:3037] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.556488 1704 leader_election.cc:288] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.556610 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d175872525cd4a95b7d62121de228f79" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.556779 1641 raft_consensus.cc:2379] T d175872525cd4a95b7d62121de228f79 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in current term 1: Already voted for candidate ea4dd09ef4f040618fc481ba902e8726 in this term.
I20240501 20:12:12.557086 1457 leader_election.cc:302] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.557266 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c88aa6fcedc6495ba20b1e5a5a59a554" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.557395 1492 raft_consensus.cc:3037] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.557824 1699 raft_consensus.cc:3037] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.557984 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c88aa6fcedc6495ba20b1e5a5a59a554" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.558097 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f759565dcf84f43b14105cf6d3ca382" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.558229 1565 raft_consensus.cc:3037] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:12:12.558382 1606 leader_election.cc:341] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.560523 1565 raft_consensus.cc:2454] T 5f759565dcf84f43b14105cf6d3ca382 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.560822 1704 raft_consensus.cc:482] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.560854 1606 leader_election.cc:302] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.561076 1684 raft_consensus.cc:2781] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.560917 1704 raft_consensus.cc:504] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.561645 1704 leader_election.cc:288] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.562088 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe80020f28649a79752351baff072a2" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:12.562464 1606 leader_election.cc:341] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.564448 1756 raft_consensus.cc:482] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.557677 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e390a9bcddb34c7eb4d9f91a0a889a5d" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.564671 1491 raft_consensus.cc:2454] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.564591 1756 raft_consensus.cc:504] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.565198 1756 leader_election.cc:288] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.565775 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802bbe84710b48be9d9ee6a15279ff9b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.565929 1641 raft_consensus.cc:2454] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:12.567162 1532 leader_election.cc:302] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.567653 1492 raft_consensus.cc:2454] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.568006 1756 raft_consensus.cc:2781] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.568079 1756 raft_consensus.cc:482] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.568135 1756 raft_consensus.cc:3037] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.569259 1604 leader_election.cc:302] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.570420 1490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe80020f28649a79752351baff072a2" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.570577 1490 raft_consensus.cc:2454] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.570784 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802bbe84710b48be9d9ee6a15279ff9b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
W20240501 20:12:12.571287 1530 leader_election.cc:341] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.571620 1604 leader_election.cc:302] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.571857 1756 raft_consensus.cc:504] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.572268 1699 raft_consensus.cc:2726] T d175872525cd4a95b7d62121de228f79 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.572660 1756 leader_election.cc:288] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.572729 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802bbe84710b48be9d9ee6a15279ff9b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.572818 1704 raft_consensus.cc:2781] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.572628 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802bbe84710b48be9d9ee6a15279ff9b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.573062 1641 raft_consensus.cc:3037] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.569736 1696 raft_consensus.cc:504] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.573699 1696 leader_election.cc:288] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
W20240501 20:12:12.573748 1530 leader_election.cc:341] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.573840 1696 raft_consensus.cc:2781] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.573900 1696 raft_consensus.cc:482] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.573968 1696 raft_consensus.cc:3037] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.572628 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f759565dcf84f43b14105cf6d3ca382" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.574251 1492 raft_consensus.cc:3037] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.574407 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e390a9bcddb34c7eb4d9f91a0a889a5d" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.574523 1565 raft_consensus.cc:3037] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.574018 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e390a9bcddb34c7eb4d9f91a0a889a5d" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.574821 1491 raft_consensus.cc:3037] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.578713 1492 raft_consensus.cc:2454] T 5f759565dcf84f43b14105cf6d3ca382 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.578763 1565 raft_consensus.cc:2454] T e390a9bcddb34c7eb4d9f91a0a889a5d P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.580804 1641 raft_consensus.cc:2454] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:12.583688 1532 leader_election.cc:302] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6
I20240501 20:12:12.583068 1491 raft_consensus.cc:2454] T e390a9bcddb34c7eb4d9f91a0a889a5d P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.584278 1604 leader_election.cc:302] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.584877 1756 raft_consensus.cc:2781] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.585088 1756 raft_consensus.cc:686] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:12.585346 1756 consensus_queue.cc:237] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.590972 1696 raft_consensus.cc:504] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.591828 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe80020f28649a79752351baff072a2" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.591987 1491 raft_consensus.cc:3037] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.594641 1491 raft_consensus.cc:2454] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.595034 1604 leader_election.cc:302] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.600980 1696 leader_election.cc:288] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.601205 1696 raft_consensus.cc:2781] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.601305 1696 raft_consensus.cc:686] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.601553 1696 consensus_queue.cc:237] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.603894 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe80020f28649a79752351baff072a2" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.605836 1799 raft_consensus.cc:2781] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.607141 1799 raft_consensus.cc:686] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.607404 1799 consensus_queue.cc:237] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.612459 1390 catalog_manager.cc:5484] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.618149 1696 raft_consensus.cc:482] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.618319 1696 raft_consensus.cc:504] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.622014 1696 leader_election.cc:288] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.622165 1696 consensus_queue.cc:1035] T fc7f9957429a40e48f910aea5f43624f P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.622274 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c4f81d151c4ed5ac6b7ecba2803d08" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.622511 1491 raft_consensus.cc:2454] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.625897 1604 leader_election.cc:302] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.626202 1696 raft_consensus.cc:2781] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.626274 1696 raft_consensus.cc:482] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.626338 1696 raft_consensus.cc:3037] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.633961 1704 raft_consensus.cc:686] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.634384 1681 tablet_bootstrap.cc:492] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.634474 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c4f81d151c4ed5ac6b7ecba2803d08" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.634533 1681 ts_tablet_manager.cc:1367] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.088s user 0.022s sys 0.041s
I20240501 20:12:12.634828 1696 raft_consensus.cc:504] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
W20240501 20:12:12.634963 1606 leader_election.cc:341] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.635277 1681 raft_consensus.cc:348] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.635466 1681 raft_consensus.cc:374] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.635543 1681 raft_consensus.cc:729] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.635766 1681 consensus_queue.cc:260] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.635828 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c4f81d151c4ed5ac6b7ecba2803d08" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.635991 1492 raft_consensus.cc:3037] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.637135 1700 consensus_queue.cc:1035] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.634249 1704 consensus_queue.cc:237] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.638478 1492 raft_consensus.cc:2454] T 73c4f81d151c4ed5ac6b7ecba2803d08 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.639025 1681 ts_tablet_manager.cc:1398] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:12.639293 1681 tablet_bootstrap.cc:492] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.635375 1696 leader_election.cc:288] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.640456 1604 leader_election.cc:302] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.640794 1793 raft_consensus.cc:2781] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.640914 1793 raft_consensus.cc:686] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
W20240501 20:12:12.635277 1606 leader_election.cc:341] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.641324 1680 tablet_bootstrap.cc:492] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.640937 1681 tablet_bootstrap.cc:654] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.641486 1680 ts_tablet_manager.cc:1367] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.026s
I20240501 20:12:12.641579 1684 raft_consensus.cc:686] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.641855 1684 consensus_queue.cc:237] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.642314 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73c4f81d151c4ed5ac6b7ecba2803d08" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.642414 1680 raft_consensus.cc:348] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.642692 1680 raft_consensus.cc:374] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.642789 1680 raft_consensus.cc:729] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
W20240501 20:12:12.642834 1606 leader_election.cc:341] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.643102 1680 consensus_queue.cc:260] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.643970 1680 ts_tablet_manager.cc:1398] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.644279 1680 tablet_bootstrap.cc:492] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.644693 1699 raft_consensus.cc:482] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.644827 1681 tablet_bootstrap.cc:492] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.644811 1699 raft_consensus.cc:504] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.644928 1681 ts_tablet_manager.cc:1367] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20240501 20:12:12.645350 1699 leader_election.cc:288] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.645510 1681 raft_consensus.cc:348] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.641549 1793 consensus_queue.cc:237] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.645680 1681 raft_consensus.cc:374] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.645848 1681 raft_consensus.cc:729] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.646117 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b2fb06d51e4f9cb28ac022594547d5" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.646325 1567 raft_consensus.cc:2454] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.646678 1457 leader_election.cc:302] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.646601 1681 consensus_queue.cc:260] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.647049 1699 raft_consensus.cc:2781] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.647151 1681 ts_tablet_manager.cc:1398] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:12.647169 1699 raft_consensus.cc:482] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.647310 1699 raft_consensus.cc:3037] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.647434 1681 tablet_bootstrap.cc:492] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.648272 1680 tablet_bootstrap.cc:654] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.648723 1681 tablet_bootstrap.cc:654] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.648833 1688 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.649223 1688 ts_tablet_manager.cc:1367] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.106s user 0.014s sys 0.029s
I20240501 20:12:12.649806 1688 raft_consensus.cc:348] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.650022 1688 raft_consensus.cc:374] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.649883 1699 raft_consensus.cc:504] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.650118 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b2fb06d51e4f9cb28ac022594547d5" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.650377 1640 raft_consensus.cc:2454] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.650107 1688 raft_consensus.cc:729] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.650728 1699 leader_election.cc:288] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.650988 1688 consensus_queue.cc:260] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.651253 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b2fb06d51e4f9cb28ac022594547d5" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.651453 1567 raft_consensus.cc:3037] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.651579 1688 ts_tablet_manager.cc:1398] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.651894 1688 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.652427 1390 catalog_manager.cc:5484] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.652946 1688 tablet_bootstrap.cc:654] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.654590 1567 raft_consensus.cc:2454] T 45b2fb06d51e4f9cb28ac022594547d5 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.655781 1457 leader_election.cc:302] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.655908 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b2fb06d51e4f9cb28ac022594547d5" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.656106 1699 raft_consensus.cc:2781] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.656162 1640 raft_consensus.cc:3037] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.656268 1699 raft_consensus.cc:686] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.656498 1699 consensus_queue.cc:237] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.663789 1389 catalog_manager.cc:5484] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.664331 1389 catalog_manager.cc:5484] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.664821 1389 catalog_manager.cc:5484] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.665303 1389 catalog_manager.cc:5484] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.668289 1390 catalog_manager.cc:5484] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.677578 1688 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.677765 1688 ts_tablet_manager.cc:1367] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20240501 20:12:12.677784 1681 tablet_bootstrap.cc:492] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.677896 1680 tablet_bootstrap.cc:492] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.678016 1680 ts_tablet_manager.cc:1367] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.001s
I20240501 20:12:12.677947 1681 ts_tablet_manager.cc:1367] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20240501 20:12:12.678478 1688 raft_consensus.cc:348] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.678532 1680 raft_consensus.cc:348] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.678717 1688 raft_consensus.cc:374] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.678771 1680 raft_consensus.cc:374] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.678838 1688 raft_consensus.cc:729] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.678913 1680 raft_consensus.cc:729] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.679081 1688 consensus_queue.cc:260] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.678722 1681 raft_consensus.cc:348] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.679136 1680 consensus_queue.cc:260] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.679342 1681 raft_consensus.cc:374] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.679422 1681 raft_consensus.cc:729] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.679587 1640 raft_consensus.cc:2454] T 45b2fb06d51e4f9cb28ac022594547d5 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.679684 1688 ts_tablet_manager.cc:1398] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.679947 1688 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.681289 1688 tablet_bootstrap.cc:654] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.681631 1681 consensus_queue.cc:260] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.682168 1681 ts_tablet_manager.cc:1398] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240501 20:12:12.682368 1698 consensus_queue.cc:1035] T d175872525cd4a95b7d62121de228f79 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.682631 1680 ts_tablet_manager.cc:1398] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:12.682933 1680 tablet_bootstrap.cc:492] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.684342 1680 tablet_bootstrap.cc:654] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.686429 1799 raft_consensus.cc:482] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.686602 1799 raft_consensus.cc:504] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.687283 1799 leader_election.cc:288] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.687858 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0c2f09e028435abb4a0660e637cefb" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.688262 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0c2f09e028435abb4a0660e637cefb" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.688475 1492 raft_consensus.cc:2454] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
W20240501 20:12:12.688875 1606 leader_election.cc:341] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.689224 1604 leader_election.cc:302] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.689726 1799 raft_consensus.cc:2781] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.689832 1799 raft_consensus.cc:482] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.689934 1799 raft_consensus.cc:3037] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.690266 1681 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.691712 1681 tablet_bootstrap.cc:654] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.692677 1799 raft_consensus.cc:504] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.693655 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0c2f09e028435abb4a0660e637cefb" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.693866 1492 raft_consensus.cc:3037] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.696625 1492 raft_consensus.cc:2454] T dd0c2f09e028435abb4a0660e637cefb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.696815 1681 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.696969 1681 ts_tablet_manager.cc:1367] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20240501 20:12:12.697239 1604 leader_election.cc:302] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.697541 1803 raft_consensus.cc:2781] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.697686 1803 raft_consensus.cc:686] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.697943 1681 raft_consensus.cc:348] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.697978 1803 consensus_queue.cc:237] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.698141 1681 raft_consensus.cc:374] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.698244 1681 raft_consensus.cc:729] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.698468 1681 consensus_queue.cc:260] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.699076 1681 ts_tablet_manager.cc:1398] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.699354 1681 tablet_bootstrap.cc:492] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.700049 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd0c2f09e028435abb4a0660e637cefb" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:12.700660 1606 leader_election.cc:341] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.700976 1793 raft_consensus.cc:482] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.701306 1793 raft_consensus.cc:504] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.701400 1799 leader_election.cc:288] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.702014 1793 leader_election.cc:288] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.702700 1699 raft_consensus.cc:482] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.702845 1699 raft_consensus.cc:504] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.703380 1699 leader_election.cc:288] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.703608 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46990a85ef946b0b40127c23e2696e9" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.703627 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bf896d96b341a9bc7125b68797a9b2" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.703739 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bf896d96b341a9bc7125b68797a9b2" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.703884 1565 raft_consensus.cc:2454] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.703927 1641 raft_consensus.cc:2454] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.703974 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46990a85ef946b0b40127c23e2696e9" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.704135 1492 raft_consensus.cc:2454] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.704336 1457 leader_election.cc:302] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
W20240501 20:12:12.704375 1606 leader_election.cc:341] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.704666 1699 raft_consensus.cc:2781] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.704864 1699 raft_consensus.cc:482] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.705093 1699 raft_consensus.cc:3037] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.705978 1680 tablet_bootstrap.cc:492] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.706154 1680 ts_tablet_manager.cc:1367] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.013s
I20240501 20:12:12.706532 1688 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.706683 1688 ts_tablet_manager.cc:1367] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.008s
I20240501 20:12:12.706823 1680 raft_consensus.cc:348] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.707068 1680 raft_consensus.cc:374] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.707147 1680 raft_consensus.cc:729] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.705102 1604 leader_election.cc:302] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.701558 1681 tablet_bootstrap.cc:654] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.707930 1793 raft_consensus.cc:2781] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.708025 1793 raft_consensus.cc:482] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.707966 1699 raft_consensus.cc:504] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.708132 1793 raft_consensus.cc:3037] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.708838 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bf896d96b341a9bc7125b68797a9b2" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.709021 1565 raft_consensus.cc:3037] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.709617 1699 leader_election.cc:288] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.707373 1680 consensus_queue.cc:260] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.707389 1688 raft_consensus.cc:348] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.710651 1793 raft_consensus.cc:504] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.710852 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bf896d96b341a9bc7125b68797a9b2" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.711102 1641 raft_consensus.cc:3037] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.710659 1680 ts_tablet_manager.cc:1398] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:12.711360 1688 raft_consensus.cc:374] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.711717 1688 raft_consensus.cc:729] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.712249 1681 tablet_bootstrap.cc:492] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.712222 1565 raft_consensus.cc:2454] T 91bf896d96b341a9bc7125b68797a9b2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.712303 1390 catalog_manager.cc:5484] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.712594 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46990a85ef946b0b40127c23e2696e9" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.712810 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46990a85ef946b0b40127c23e2696e9" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.712986 1491 raft_consensus.cc:3037] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:12:12.713148 1606 leader_election.cc:341] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.713315 1793 leader_election.cc:288] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.713476 1699 raft_consensus.cc:482] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.713599 1699 raft_consensus.cc:504] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.714226 1699 leader_election.cc:288] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.714255 1641 raft_consensus.cc:2454] T 91bf896d96b341a9bc7125b68797a9b2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.714504 1681 ts_tablet_manager.cc:1367] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20240501 20:12:12.714586 1457 leader_election.cc:302] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.715164 1681 raft_consensus.cc:348] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.715373 1681 raft_consensus.cc:374] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.715472 1681 raft_consensus.cc:729] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.715531 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599e699186cd4a8ebf71634a746d7f1a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.715600 1699 raft_consensus.cc:2781] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.715759 1681 consensus_queue.cc:260] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
W20240501 20:12:12.716104 1457 leader_election.cc:341] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.715483 1491 raft_consensus.cc:2454] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.716130 1699 raft_consensus.cc:686] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.716276 1681 ts_tablet_manager.cc:1398] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:12.715610 1680 tablet_bootstrap.cc:492] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.716578 1681 tablet_bootstrap.cc:492] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.716491 1699 consensus_queue.cc:237] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.717028 1604 leader_election.cc:302] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.717691 1793 raft_consensus.cc:2781] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.717779 1680 tablet_bootstrap.cc:654] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.717912 1681 tablet_bootstrap.cc:654] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.718087 1793 raft_consensus.cc:686] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.718379 1793 consensus_queue.cc:237] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.719815 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599e699186cd4a8ebf71634a746d7f1a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.720037 1641 raft_consensus.cc:2454] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:12.720466 1457 leader_election.cc:302] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.720887 1752 raft_consensus.cc:2781] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.721092 1752 raft_consensus.cc:482] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.721221 1752 raft_consensus.cc:3037] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.724001 1752 raft_consensus.cc:504] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.724629 1752 leader_election.cc:288] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.725258 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599e699186cd4a8ebf71634a746d7f1a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.725870 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599e699186cd4a8ebf71634a746d7f1a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:12.726073 1641 raft_consensus.cc:3037] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.728854 1641 raft_consensus.cc:2454] T 599e699186cd4a8ebf71634a746d7f1a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:12.729274 1457 leader_election.cc:302] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
W20240501 20:12:12.729610 1457 leader_election.cc:341] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.729943 1752 raft_consensus.cc:2781] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.730190 1752 raft_consensus.cc:686] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:12.730473 1752 consensus_queue.cc:237] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.714522 1688 consensus_queue.cc:260] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.733670 1745 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.736521 1688 ts_tablet_manager.cc:1398] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20240501 20:12:12.736877 1688 tablet_bootstrap.cc:492] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.739990 1688 tablet_bootstrap.cc:654] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.752977 1745 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.759356 1803 raft_consensus.cc:482] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.759562 1803 raft_consensus.cc:504] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.760293 1803 leader_election.cc:288] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.760569 1698 raft_consensus.cc:482] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.760722 1698 raft_consensus.cc:504] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.760989 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614478290e894be8956ebca5615d791b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.761217 1491 raft_consensus.cc:2454] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.761304 1698 leader_election.cc:288] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.761960 1604 leader_election.cc:302] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.762014 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c88aa6fcedc6495ba20b1e5a5a59a554" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.762635 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c88aa6fcedc6495ba20b1e5a5a59a554" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.762888 1491 raft_consensus.cc:2379] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:12.763304 1530 leader_election.cc:302] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:12.763446 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614478290e894be8956ebca5615d791b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.763687 1698 raft_consensus.cc:3037] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:12:12.763832 1606 leader_election.cc:341] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.763319 1803 raft_consensus.cc:2781] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.765228 1803 raft_consensus.cc:482] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.765331 1803 raft_consensus.cc:3037] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.766791 1390 catalog_manager.cc:5484] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.767841 1803 raft_consensus.cc:504] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.770385 1698 raft_consensus.cc:2726] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.771392 1681 tablet_bootstrap.cc:492] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.771543 1681 ts_tablet_manager.cc:1367] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.055s user 0.023s sys 0.031s
I20240501 20:12:12.771950 1803 leader_election.cc:288] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.772164 1688 tablet_bootstrap.cc:492] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.772346 1681 raft_consensus.cc:348] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.772485 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614478290e894be8956ebca5615d791b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.772600 1681 raft_consensus.cc:374] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.772701 1681 raft_consensus.cc:729] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.773301 1681 consensus_queue.cc:260] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.773680 1680 tablet_bootstrap.cc:492] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.773525 1390 catalog_manager.cc:5484] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.773804 1680 ts_tablet_manager.cc:1367] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.062s user 0.018s sys 0.027s
I20240501 20:12:12.773949 1491 raft_consensus.cc:3037] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.774012 1681 ts_tablet_manager.cc:1398] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.774277 1681 tablet_bootstrap.cc:492] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.774421 1680 raft_consensus.cc:348] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.772372 1688 ts_tablet_manager.cc:1367] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.003s
I20240501 20:12:12.772491 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614478290e894be8956ebca5615d791b" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.774600 1680 raft_consensus.cc:374] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.775576 1680 raft_consensus.cc:729] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.775687 1681 tablet_bootstrap.cc:654] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.775864 1680 consensus_queue.cc:260] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.775312 1688 raft_consensus.cc:348] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.776269 1688 raft_consensus.cc:374] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.776430 1688 raft_consensus.cc:729] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.776499 1491 raft_consensus.cc:2454] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.776902 1698 raft_consensus.cc:482] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.777124 1698 raft_consensus.cc:504] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.776463 1680 ts_tablet_manager.cc:1398] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:12:12.777750 1698 leader_election.cc:288] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.776762 1688 consensus_queue.cc:260] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.777751 1680 tablet_bootstrap.cc:492] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.778178 1681 tablet_bootstrap.cc:492] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.778360 1688 ts_tablet_manager.cc:1398] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:12:12.778462 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe80020f28649a79752351baff072a2" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.776913 1604 leader_election.cc:302] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.778677 1492 raft_consensus.cc:2379] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:12.778883 1681 ts_tablet_manager.cc:1367] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
W20240501 20:12:12.778926 1606 leader_election.cc:341] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.779426 1803 raft_consensus.cc:2781] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.779511 1681 raft_consensus.cc:348] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.779592 1803 raft_consensus.cc:686] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.779721 1681 raft_consensus.cc:374] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.779805 1681 raft_consensus.cc:729] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.779840 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbe80020f28649a79752351baff072a2" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.779866 1803 consensus_queue.cc:237] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.780019 1681 consensus_queue.cc:260] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.780586 1681 ts_tablet_manager.cc:1398] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:12.780872 1681 tablet_bootstrap.cc:492] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.782160 1681 tablet_bootstrap.cc:654] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.783353 1532 leader_election.cc:302] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:12.783787 1698 raft_consensus.cc:3037] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.779599 1680 tablet_bootstrap.cc:654] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.786450 1681 tablet_bootstrap.cc:492] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.786473 1698 raft_consensus.cc:2726] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.786300 1388 catalog_manager.cc:5484] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:12.786618 1681 ts_tablet_manager.cc:1367] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20240501 20:12:12.787374 1681 raft_consensus.cc:348] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.787488 1680 tablet_bootstrap.cc:492] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.787724 1688 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.787847 1680 ts_tablet_manager.cc:1367] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20240501 20:12:12.788403 1680 raft_consensus.cc:348] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.788596 1680 raft_consensus.cc:374] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.788681 1680 raft_consensus.cc:729] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.788980 1688 tablet_bootstrap.cc:654] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.788920 1680 consensus_queue.cc:260] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.789243 1793 raft_consensus.cc:482] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.789439 1680 ts_tablet_manager.cc:1398] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 20:12:12.789389 1793 raft_consensus.cc:504] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.789719 1680 tablet_bootstrap.cc:492] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.790004 1793 leader_election.cc:288] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.787560 1681 raft_consensus.cc:374] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.788715 1390 catalog_manager.cc:5484] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:12.790984 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a1b45e9be5446cb5ad18906381d9fd" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
W20240501 20:12:12.791858 1604 leader_election.cc:341] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.791945 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a1b45e9be5446cb5ad18906381d9fd" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.792223 1681 raft_consensus.cc:729] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
W20240501 20:12:12.792405 1606 leader_election.cc:341] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.792447 1681 consensus_queue.cc:260] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.792536 1606 leader_election.cc:302] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.792950 1803 raft_consensus.cc:2726] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.792995 1681 ts_tablet_manager.cc:1398] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240501 20:12:12.793421 1681 tablet_bootstrap.cc:492] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.793542 1680 tablet_bootstrap.cc:654] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.794685 1681 tablet_bootstrap.cc:654] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.796995 1752 consensus_queue.cc:1035] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.798177 1688 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.798352 1688 ts_tablet_manager.cc:1367] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20240501 20:12:12.798986 1688 raft_consensus.cc:348] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.799221 1688 raft_consensus.cc:374] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.799300 1688 raft_consensus.cc:729] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.799571 1688 consensus_queue.cc:260] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.802625 1688 ts_tablet_manager.cc:1398] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:12.807013 1688 tablet_bootstrap.cc:492] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.807602 1745 consensus_queue.cc:1035] T 35fb57ac07c14ded9253288b2cf6b196 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.808527 1685 consensus_queue.cc:1035] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.811740 1698 raft_consensus.cc:482] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.811931 1698 raft_consensus.cc:504] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.812577 1698 leader_election.cc:288] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.813339 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259e5b9c72f84518b1269ce8688ef32f" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.814076 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "259e5b9c72f84518b1269ce8688ef32f" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.814399 1640 raft_consensus.cc:2379] T 259e5b9c72f84518b1269ce8688ef32f P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in this term.
I20240501 20:12:12.814837 1532 leader_election.cc:302] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:12.815341 1698 raft_consensus.cc:3037] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.816437 1688 tablet_bootstrap.cc:654] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.818233 1698 raft_consensus.cc:2726] T 259e5b9c72f84518b1269ce8688ef32f P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.826295 1803 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.829069 1698 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.833643 1700 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.833768 1793 raft_consensus.cc:482] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.833921 1793 raft_consensus.cc:504] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.834527 1793 leader_election.cc:288] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.834746 1680 tablet_bootstrap.cc:492] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.834895 1680 ts_tablet_manager.cc:1367] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.045s user 0.014s sys 0.015s
I20240501 20:12:12.835039 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055a0d2bb3c047aea3f375153145cb42" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.835237 1565 raft_consensus.cc:2454] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.835603 1606 leader_election.cc:302] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.835892 1793 raft_consensus.cc:2781] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.835992 1793 raft_consensus.cc:482] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.835932 1680 raft_consensus.cc:348] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.836108 1793 raft_consensus.cc:3037] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.836555 1681 tablet_bootstrap.cc:492] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.836709 1681 ts_tablet_manager.cc:1367] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.043s user 0.009s sys 0.028s
I20240501 20:12:12.837334 1681 raft_consensus.cc:348] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.837549 1681 raft_consensus.cc:374] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.837637 1681 raft_consensus.cc:729] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.838825 1793 raft_consensus.cc:504] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.839419 1793 leader_election.cc:288] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.839716 1681 consensus_queue.cc:260] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.839825 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055a0d2bb3c047aea3f375153145cb42" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.839991 1565 raft_consensus.cc:3037] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.840094 1490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055a0d2bb3c047aea3f375153145cb42" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.840266 1490 raft_consensus.cc:2454] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.840690 1681 ts_tablet_manager.cc:1398] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:12:12.836117 1680 raft_consensus.cc:374] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.840875 1680 raft_consensus.cc:729] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.840981 1681 tablet_bootstrap.cc:492] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.841107 1680 consensus_queue.cc:260] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.841703 1680 ts_tablet_manager.cc:1398] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240501 20:12:12.841964 1680 tablet_bootstrap.cc:492] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:12.842334 1681 tablet_bootstrap.cc:654] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.842526 1565 raft_consensus.cc:2454] T 055a0d2bb3c047aea3f375153145cb42 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.842888 1606 leader_election.cc:302] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:12.842924 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055a0d2bb3c047aea3f375153145cb42" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.843161 1793 raft_consensus.cc:2781] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.843191 1489 raft_consensus.cc:3037] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.843281 1680 tablet_bootstrap.cc:654] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.843322 1793 raft_consensus.cc:686] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.843567 1793 consensus_queue.cc:237] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.846621 1700 consensus_queue.cc:1035] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.846724 1756 raft_consensus.cc:482] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.846860 1756 raft_consensus.cc:504] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.847441 1756 leader_election.cc:288] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.847966 1490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04ba7f3ce10406fb8c299b54fa3299b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.849014 1565 raft_consensus.cc:3037] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.849110 1799 consensus_queue.cc:1035] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.849014 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04ba7f3ce10406fb8c299b54fa3299b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.849915 1532 leader_election.cc:302] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:12.833739 1688 tablet_bootstrap.cc:492] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:12.861377 1489 raft_consensus.cc:2454] T 055a0d2bb3c047aea3f375153145cb42 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:12.861367 1745 consensus_queue.cc:1035] T dc1c73dc1c684af1a5792ad2ab6e3fff P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240501 20:12:12.863211 1799 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240501 20:12:12.864418 1688 ts_tablet_manager.cc:1367] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.004s
I20240501 20:12:12.868153 1756 raft_consensus.cc:2726] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.868228 1688 raft_consensus.cc:348] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.868410 1688 raft_consensus.cc:374] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.868500 1688 raft_consensus.cc:729] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.872493 1688 consensus_queue.cc:260] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.879967 1745 consensus_queue.cc:1035] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240501 20:12:12.883076 1756 consensus_queue.cc:1035] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.884799 1799 raft_consensus.cc:482] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.884979 1799 raft_consensus.cc:504] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.885607 1799 leader_election.cc:288] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.886672 1490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32b168a9a8104ccbab55dfc28be4a612" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.886898 1490 raft_consensus.cc:2454] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.889305 1799 consensus_queue.cc:1035] T aca56ce912074ec987a2d52e271e8c39 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.889667 1604 leader_election.cc:302] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.889945 1799 raft_consensus.cc:2781] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.890064 1799 raft_consensus.cc:482] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.890156 1799 raft_consensus.cc:3037] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.890455 1752 consensus_queue.cc:1035] T 259e5b9c72f84518b1269ce8688ef32f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.892869 1799 raft_consensus.cc:504] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.893862 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32b168a9a8104ccbab55dfc28be4a612" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:12.893932 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32b168a9a8104ccbab55dfc28be4a612" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.894061 1491 raft_consensus.cc:3037] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.896728 1491 raft_consensus.cc:2454] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
W20240501 20:12:12.897384 1606 leader_election.cc:341] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.897455 1604 leader_election.cc:302] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:12.897703 1803 raft_consensus.cc:2781] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:12.897810 1803 raft_consensus.cc:686] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:12.898047 1803 consensus_queue.cc:237] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.899145 1799 leader_election.cc:288] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.911307 1681 tablet_bootstrap.cc:492] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.911460 1681 ts_tablet_manager.cc:1367] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.017s
I20240501 20:12:12.912443 1688 ts_tablet_manager.cc:1398] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20240501 20:12:12.912927 1803 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.913354 1681 raft_consensus.cc:348] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.913522 1681 raft_consensus.cc:374] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.913575 1681 raft_consensus.cc:729] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.913753 1681 consensus_queue.cc:260] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.913982 1563 raft_consensus.cc:3037] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.914228 1681 ts_tablet_manager.cc:1398] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 20:12:12.914446 1681 tablet_bootstrap.cc:492] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:12.919811 1745 raft_consensus.cc:482] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.919951 1745 raft_consensus.cc:504] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.920452 1688 tablet_bootstrap.cc:492] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:12.922035 1688 tablet_bootstrap.cc:654] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.922739 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32b168a9a8104ccbab55dfc28be4a612" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:12.923698 1681 tablet_bootstrap.cc:654] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:12.925410 1745 leader_election.cc:288] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.926086 1745 consensus_queue.cc:1035] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 20:12:12.926294 1606 leader_election.cc:341] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.926456 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802bbe84710b48be9d9ee6a15279ff9b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.919876 1803 consensus_queue.cc:1035] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20240501 20:12:12.927095 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802bbe84710b48be9d9ee6a15279ff9b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.927280 1639 raft_consensus.cc:2379] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in current term 1: Already voted for candidate ea4dd09ef4f040618fc481ba902e8726 in this term.
I20240501 20:12:12.929673 1685 raft_consensus.cc:482] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.929823 1685 raft_consensus.cc:504] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.937644 1803 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.946416 1685 leader_election.cc:288] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:12.949111 1803 raft_consensus.cc:482] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.949266 1803 raft_consensus.cc:504] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.960098 1457 leader_election.cc:302] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.960354 1685 raft_consensus.cc:3037] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.960830 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9d9af841834c8bac7406a2dbad0b55" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.961181 1566 raft_consensus.cc:2379] T 0a9d9af841834c8bac7406a2dbad0b55 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:12.961742 1803 leader_election.cc:288] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.962513 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13c2438cee84fcc9d98256bbf641222" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:12.963003 1606 leader_election.cc:341] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.965229 1756 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20240501 20:12:12.966919 1803 raft_consensus.cc:482] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:12.966926 1704 consensus_queue.cc:1035] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.967075 1803 raft_consensus.cc:504] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.967692 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a9d9af841834c8bac7406a2dbad0b55" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:12.968271 1803 leader_election.cc:288] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:12.969481 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c95b72ede9fc487b87490e2d4a75e261" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
W20240501 20:12:12.969992 1604 leader_election.cc:341] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.970793 1457 leader_election.cc:302] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.971029 1745 raft_consensus.cc:3037] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.974391 1745 raft_consensus.cc:2726] T 0a9d9af841834c8bac7406a2dbad0b55 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.974653 1490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13c2438cee84fcc9d98256bbf641222" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:12.974859 1490 raft_consensus.cc:2454] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:12.975540 1604 leader_election.cc:302] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.976330 1803 raft_consensus.cc:2781] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:12.976413 1803 raft_consensus.cc:482] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:12.976470 1803 raft_consensus.cc:3037] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:12.980818 1680 tablet_bootstrap.cc:492] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:12.969122 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c95b72ede9fc487b87490e2d4a75e261" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:12.981009 1680 ts_tablet_manager.cc:1367] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.139s user 0.009s sys 0.017s
I20240501 20:12:12.981756 1680 raft_consensus.cc:348] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.981945 1680 raft_consensus.cc:374] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:12.981990 1680 raft_consensus.cc:729] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:12.983296 1704 consensus_queue.cc:1035] T 0a9d9af841834c8bac7406a2dbad0b55 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:12.983376 1680 consensus_queue.cc:260] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:12.984256 1680 ts_tablet_manager.cc:1398] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 20:12:12.984529 1680 tablet_bootstrap.cc:492] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
W20240501 20:12:12.987879 1606 leader_election.cc:341] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:12.987996 1606 leader_election.cc:302] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:12.996124 1793 raft_consensus.cc:2726] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:12.997718 1681 tablet_bootstrap.cc:492] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:12.998644 1681 ts_tablet_manager.cc:1367] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.011s
I20240501 20:12:12.997215 1699 consensus_queue.cc:1035] T fb27ad1cad004e74896f221012308e97 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.008191 1800 consensus_queue.cc:1035] T a197f73ccd5f41038acbd61a5a631c79 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.008260 1803 raft_consensus.cc:504] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.009846 1390 catalog_manager.cc:5484] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.013300 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13c2438cee84fcc9d98256bbf641222" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.013456 1492 raft_consensus.cc:3037] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.014262 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c13c2438cee84fcc9d98256bbf641222" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.014757 1606 leader_election.cc:341] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.014954 1803 leader_election.cc:288] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.016337 1685 raft_consensus.cc:2726] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.017345 1492 raft_consensus.cc:2454] T c13c2438cee84fcc9d98256bbf641222 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.018862 1604 leader_election.cc:302] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.019361 1680 tablet_bootstrap.cc:654] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.020618 1803 raft_consensus.cc:2781] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.020785 1803 raft_consensus.cc:686] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.021000 1803 consensus_queue.cc:237] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.024636 1688 tablet_bootstrap.cc:492] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.024760 1688 ts_tablet_manager.cc:1367] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.112s user 0.017s sys 0.024s
I20240501 20:12:13.025393 1688 raft_consensus.cc:348] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.025563 1688 raft_consensus.cc:374] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.025617 1688 raft_consensus.cc:729] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.025769 1688 consensus_queue.cc:260] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.026226 1688 ts_tablet_manager.cc:1398] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 20:12:13.026464 1688 tablet_bootstrap.cc:492] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.027298 1681 raft_consensus.cc:348] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.027473 1681 raft_consensus.cc:374] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.028717 1681 raft_consensus.cc:729] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.028894 1681 consensus_queue.cc:260] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.027731 1688 tablet_bootstrap.cc:654] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.029436 1681 ts_tablet_manager.cc:1398] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.030s user 0.001s sys 0.000s
I20240501 20:12:13.029453 1756 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.029687 1681 tablet_bootstrap.cc:492] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.030962 1681 tablet_bootstrap.cc:654] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.034582 1684 consensus_queue.cc:1035] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.036602 1387 catalog_manager.cc:5484] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.037187 1756 raft_consensus.cc:482] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.037289 1756 raft_consensus.cc:504] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.037323 1387 catalog_manager.cc:5484] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.037824 1756 leader_election.cc:288] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.038290 1491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46990a85ef946b0b40127c23e2696e9" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.038463 1491 raft_consensus.cc:2379] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:13.040256 1688 tablet_bootstrap.cc:492] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.040376 1688 ts_tablet_manager.cc:1367] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.007s
I20240501 20:12:13.040992 1688 raft_consensus.cc:348] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.041185 1688 raft_consensus.cc:374] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.041231 1688 raft_consensus.cc:729] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.041435 1688 consensus_queue.cc:260] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.041967 1688 ts_tablet_manager.cc:1398] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:13.042217 1688 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.042685 1639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f46990a85ef946b0b40127c23e2696e9" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.043284 1532 leader_election.cc:302] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:13.044047 1685 consensus_queue.cc:1035] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.044903 1700 raft_consensus.cc:3037] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.045964 1684 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.046947 1680 tablet_bootstrap.cc:492] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.047065 1680 ts_tablet_manager.cc:1367] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.000s
I20240501 20:12:13.047611 1680 raft_consensus.cc:348] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.047770 1700 raft_consensus.cc:2726] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.048821 1688 tablet_bootstrap.cc:654] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.047775 1680 raft_consensus.cc:374] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.050787 1680 raft_consensus.cc:729] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.051365 1680 consensus_queue.cc:260] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.053689 1680 ts_tablet_manager.cc:1398] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20240501 20:12:13.053923 1680 tablet_bootstrap.cc:492] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.055219 1680 tablet_bootstrap.cc:654] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.063661 1800 consensus_queue.cc:1035] T 5f759565dcf84f43b14105cf6d3ca382 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.068789 1688 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.068923 1688 ts_tablet_manager.cc:1367] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.006s
I20240501 20:12:13.068921 1745 consensus_queue.cc:1035] T 45b2fb06d51e4f9cb28ac022594547d5 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.069648 1688 raft_consensus.cc:348] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.069831 1688 raft_consensus.cc:374] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.069890 1688 raft_consensus.cc:729] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.070081 1688 consensus_queue.cc:260] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.070581 1688 ts_tablet_manager.cc:1398] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:13.070835 1688 tablet_bootstrap.cc:492] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.071426 1700 consensus_queue.cc:1035] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.071763 1745 raft_consensus.cc:482] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.071873 1745 raft_consensus.cc:504] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.072177 1688 tablet_bootstrap.cc:654] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.072415 1745 leader_election.cc:288] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.072916 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34308521f7b7481fafef0344fec556f2" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:13.073385 1457 leader_election.cc:341] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.073748 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34308521f7b7481fafef0344fec556f2" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
W20240501 20:12:13.074298 1457 leader_election.cc:341] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.074396 1457 leader_election.cc:302] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.074723 1745 raft_consensus.cc:2726] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.082438 1700 raft_consensus.cc:482] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.082551 1700 raft_consensus.cc:504] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.083083 1700 leader_election.cc:288] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.083614 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614478290e894be8956ebca5615d791b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.083586 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "614478290e894be8956ebca5615d791b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.083784 1489 raft_consensus.cc:2379] T 614478290e894be8956ebca5615d791b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:13.084123 1532 leader_election.cc:302] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:13.084543 1700 raft_consensus.cc:3037] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.087970 1800 consensus_queue.cc:1035] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.090413 1700 raft_consensus.cc:2726] T 614478290e894be8956ebca5615d791b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.093367 1800 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.096233 1800 consensus_queue.cc:1035] T e390a9bcddb34c7eb4d9f91a0a889a5d P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.096959 1745 raft_consensus.cc:482] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.097081 1745 raft_consensus.cc:504] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.097597 1745 leader_election.cc:288] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.098145 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925e23a6cc4c3e9fbb3b33cf39d72a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.098217 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925e23a6cc4c3e9fbb3b33cf39d72a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
W20240501 20:12:13.098591 1457 leader_election.cc:341] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:13.098783 1457 leader_election.cc:341] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.098861 1457 leader_election.cc:302] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6; no voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.099210 1745 raft_consensus.cc:2726] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.105760 1800 raft_consensus.cc:482] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.105890 1800 raft_consensus.cc:504] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.106474 1800 leader_election.cc:288] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.107213 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6c65585f2c40c5bc072744c8b7b183" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.107370 1488 raft_consensus.cc:2454] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.107571 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6c65585f2c40c5bc072744c8b7b183" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.108137 1604 leader_election.cc:302] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.108165 1756 consensus_queue.cc:1035] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 20:12:13.108402 1606 leader_election.cc:341] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.109633 1800 raft_consensus.cc:2781] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.109710 1800 raft_consensus.cc:482] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.109781 1800 raft_consensus.cc:3037] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.110638 1680 tablet_bootstrap.cc:492] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.110754 1680 ts_tablet_manager.cc:1367] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20240501 20:12:13.111382 1680 raft_consensus.cc:348] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.111531 1680 raft_consensus.cc:374] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.111568 1680 raft_consensus.cc:729] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.112304 1800 raft_consensus.cc:504] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.112501 1680 consensus_queue.cc:260] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.113862 1490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6c65585f2c40c5bc072744c8b7b183" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.114009 1490 raft_consensus.cc:3037] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.116777 1490 raft_consensus.cc:2454] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.117162 1604 leader_election.cc:302] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.117408 1803 raft_consensus.cc:2781] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.117509 1803 raft_consensus.cc:686] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.117753 1803 consensus_queue.cc:237] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.118430 1800 leader_election.cc:288] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.118494 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6c65585f2c40c5bc072744c8b7b183" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.119041 1606 leader_election.cc:341] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.127043 1745 raft_consensus.cc:482] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.127194 1745 raft_consensus.cc:504] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.127763 1745 leader_election.cc:288] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.128329 1567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d88af9fa98d343d4a1f00181f0eb5162" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.128507 1567 raft_consensus.cc:2454] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.128991 1457 leader_election.cc:302] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.129796 1745 raft_consensus.cc:2781] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.129881 1745 raft_consensus.cc:482] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.129949 1745 raft_consensus.cc:3037] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.132719 1745 raft_consensus.cc:504] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.133587 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d88af9fa98d343d4a1f00181f0eb5162" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.133754 1564 raft_consensus.cc:3037] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.136586 1704 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.136790 1564 raft_consensus.cc:2454] T d88af9fa98d343d4a1f00181f0eb5162 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.137610 1457 leader_election.cc:302] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.137981 1699 raft_consensus.cc:2781] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.138090 1699 raft_consensus.cc:686] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.138329 1699 consensus_queue.cc:237] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.139714 1831 consensus_queue.cc:1035] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.140157 1831 consensus_queue.cc:1035] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.142915 1745 leader_election.cc:288] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.143407 1637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d88af9fa98d343d4a1f00181f0eb5162" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.143545 1637 raft_consensus.cc:3037] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.144059 1704 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.146162 1637 raft_consensus.cc:2454] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.150395 1680 ts_tablet_manager.cc:1398] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.040s user 0.001s sys 0.001s
I20240501 20:12:13.150662 1680 tablet_bootstrap.cc:492] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.152117 1680 tablet_bootstrap.cc:654] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.158332 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d88af9fa98d343d4a1f00181f0eb5162" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.159404 1640 raft_consensus.cc:2362] T d88af9fa98d343d4a1f00181f0eb5162 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1. Re-sending same reply.
I20240501 20:12:13.160276 1745 consensus_queue.cc:1035] T e369ffe23d6b4eb58c8031d82cc89e3b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.168257 1800 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 20:12:13.169579 1457 consensus_peers.cc:485] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 -> Peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Couldn't send request to peer ea4dd09ef4f040618fc481ba902e8726. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:13.172029 1800 consensus_queue.cc:1035] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 20:12:13.177384 1438 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20240501 20:12:13.177738 1606 consensus_peers.cc:485] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b -> Peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Couldn't send request to peer ea4dd09ef4f040618fc481ba902e8726. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:13.181187 1681 tablet_bootstrap.cc:492] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.181360 1681 ts_tablet_manager.cc:1367] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.152s user 0.045s sys 0.098s
I20240501 20:12:13.182051 1681 raft_consensus.cc:348] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.182323 1681 raft_consensus.cc:374] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.182413 1681 raft_consensus.cc:729] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.182654 1681 consensus_queue.cc:260] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.183250 1680 tablet_bootstrap.cc:492] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.183658 1681 ts_tablet_manager.cc:1398] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:13.183796 1745 consensus_queue.cc:1035] T 91bf896d96b341a9bc7125b68797a9b2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.184127 1681 tablet_bootstrap.cc:492] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.185562 1681 tablet_bootstrap.cc:654] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.185838 1688 tablet_bootstrap.cc:492] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.185954 1688 ts_tablet_manager.cc:1367] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.115s user 0.024s sys 0.030s
I20240501 20:12:13.183804 1680 ts_tablet_manager.cc:1367] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.002s
I20240501 20:12:13.186533 1688 raft_consensus.cc:348] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.186702 1688 raft_consensus.cc:374] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.186759 1688 raft_consensus.cc:729] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.187135 1680 raft_consensus.cc:348] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.187348 1680 raft_consensus.cc:374] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.187430 1680 raft_consensus.cc:729] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.187669 1680 consensus_queue.cc:260] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.188253 1680 ts_tablet_manager.cc:1398] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:13.188531 1680 tablet_bootstrap.cc:492] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.190002 1680 tablet_bootstrap.cc:654] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.189939 1688 consensus_queue.cc:260] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.191118 1688 ts_tablet_manager.cc:1398] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 20:12:13.191368 1688 tablet_bootstrap.cc:492] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.192531 1800 consensus_queue.cc:1035] T 614478290e894be8956ebca5615d791b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.195390 1680 tablet_bootstrap.cc:492] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.195888 1680 ts_tablet_manager.cc:1367] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240501 20:12:13.196317 1800 consensus_queue.cc:1035] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.195648 1688 tablet_bootstrap.cc:654] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.197845 1680 raft_consensus.cc:348] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.198976 1681 tablet_bootstrap.cc:492] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.199177 1681 ts_tablet_manager.cc:1367] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.002s
I20240501 20:12:13.199847 1681 raft_consensus.cc:348] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.200076 1681 raft_consensus.cc:374] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.200167 1681 raft_consensus.cc:729] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.200385 1681 consensus_queue.cc:260] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.200908 1681 ts_tablet_manager.cc:1398] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:13.201211 1681 tablet_bootstrap.cc:492] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.202517 1681 tablet_bootstrap.cc:654] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.202620 1680 raft_consensus.cc:374] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.203464 1680 raft_consensus.cc:729] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.203718 1680 consensus_queue.cc:260] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.205263 1680 ts_tablet_manager.cc:1398] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 20:12:13.205520 1680 tablet_bootstrap.cc:492] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.209606 1564 raft_consensus.cc:3037] T 73c4f81d151c4ed5ac6b7ecba2803d08 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.215327 1800 consensus_queue.cc:1035] T 73c4f81d151c4ed5ac6b7ecba2803d08 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.216840 1680 tablet_bootstrap.cc:654] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.218974 1681 tablet_bootstrap.cc:492] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.219113 1681 ts_tablet_manager.cc:1367] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.007s
I20240501 20:12:13.223569 1680 tablet_bootstrap.cc:492] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.223696 1680 ts_tablet_manager.cc:1367] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20240501 20:12:13.223942 1699 raft_consensus.cc:482] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.224071 1699 raft_consensus.cc:504] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.224485 1680 raft_consensus.cc:348] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.224663 1680 raft_consensus.cc:374] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.224725 1699 leader_election.cc:288] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.225431 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3da872ddf5d48e1a7c2f7f297a93bb1" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.225605 1641 raft_consensus.cc:2454] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.225651 1681 raft_consensus.cc:348] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.225836 1681 raft_consensus.cc:374] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.225883 1681 raft_consensus.cc:729] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.225962 1457 leader_election.cc:302] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.226095 1681 consensus_queue.cc:260] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.226239 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3da872ddf5d48e1a7c2f7f297a93bb1" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.226401 1563 raft_consensus.cc:2454] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.226593 1681 ts_tablet_manager.cc:1398] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20240501 20:12:13.226619 1745 raft_consensus.cc:2781] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.226687 1745 raft_consensus.cc:482] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.226755 1745 raft_consensus.cc:3037] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.226866 1681 tablet_bootstrap.cc:492] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.227124 1390 catalog_manager.cc:5484] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.228622 1681 tablet_bootstrap.cc:654] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.229930 1745 raft_consensus.cc:504] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.230545 1745 leader_election.cc:288] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.224726 1680 raft_consensus.cc:729] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.235239 1680 consensus_queue.cc:260] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.235780 1680 ts_tablet_manager.cc:1398] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20240501 20:12:13.236027 1680 tablet_bootstrap.cc:492] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.237756 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3da872ddf5d48e1a7c2f7f297a93bb1" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.237915 1641 raft_consensus.cc:3037] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.238269 1803 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.239509 1681 tablet_bootstrap.cc:492] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.239938 1681 ts_tablet_manager.cc:1367] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.002s
I20240501 20:12:13.240799 1641 raft_consensus.cc:2454] T f3da872ddf5d48e1a7c2f7f297a93bb1 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.241201 1457 leader_election.cc:302] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.241490 1685 raft_consensus.cc:2781] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.241592 1685 raft_consensus.cc:686] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.240796 1681 raft_consensus.cc:348] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.241830 1685 consensus_queue.cc:237] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.242376 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3da872ddf5d48e1a7c2f7f297a93bb1" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.242522 1563 raft_consensus.cc:3037] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.245182 1831 raft_consensus.cc:482] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.245306 1831 raft_consensus.cc:504] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.245934 1831 leader_election.cc:288] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.246780 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd7cfd1931740538e0225f4ae54a11b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.246918 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd7cfd1931740538e0225f4ae54a11b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.247102 1638 raft_consensus.cc:2454] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
W20240501 20:12:13.247176 1457 leader_election.cc:341] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.247433 1457 leader_election.cc:302] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.248250 1699 raft_consensus.cc:2781] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.248335 1699 raft_consensus.cc:482] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.248401 1699 raft_consensus.cc:3037] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.251019 1680 tablet_bootstrap.cc:654] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.250926 1699 raft_consensus.cc:504] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.252188 1699 leader_election.cc:288] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.252537 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd7cfd1931740538e0225f4ae54a11b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.252687 1641 raft_consensus.cc:3037] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.253881 1681 raft_consensus.cc:374] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.254122 1563 raft_consensus.cc:2454] T f3da872ddf5d48e1a7c2f7f297a93bb1 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.254197 1681 raft_consensus.cc:729] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.254688 1681 consensus_queue.cc:260] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.255596 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd7cfd1931740538e0225f4ae54a11b" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.255999 1457 leader_election.cc:341] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.256551 1681 ts_tablet_manager.cc:1398] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20240501 20:12:13.257448 1681 tablet_bootstrap.cc:492] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.258255 1641 raft_consensus.cc:2454] T 2cd7cfd1931740538e0225f4ae54a11b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.258569 1457 leader_election.cc:302] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.258941 1745 raft_consensus.cc:2781] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.259048 1745 raft_consensus.cc:686] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.259261 1745 consensus_queue.cc:237] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.262092 1699 raft_consensus.cc:482] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.262219 1699 raft_consensus.cc:504] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.263612 1390 catalog_manager.cc:5484] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.267729 1800 raft_consensus.cc:482] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.267846 1800 raft_consensus.cc:504] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.269448 1800 leader_election.cc:288] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.270287 1699 leader_election.cc:288] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.271677 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b62689a9a324b1293e98ef3d09f2419" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.272058 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a1b45e9be5446cb5ad18906381d9fd" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.272357 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a1b45e9be5446cb5ad18906381d9fd" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.272537 1641 raft_consensus.cc:2454] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
W20240501 20:12:13.273088 1606 leader_election.cc:341] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.273536 1457 leader_election.cc:302] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
W20240501 20:12:13.273823 1457 leader_election.cc:341] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.274385 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b62689a9a324b1293e98ef3d09f2419" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.274389 1745 raft_consensus.cc:2781] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.274989 1489 raft_consensus.cc:2454] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.275355 1604 leader_election.cc:302] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.275701 1800 raft_consensus.cc:2781] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.276005 1800 raft_consensus.cc:482] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.276124 1800 raft_consensus.cc:3037] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.277206 1745 raft_consensus.cc:482] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.278967 1688 tablet_bootstrap.cc:492] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.279170 1745 raft_consensus.cc:3037] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.281791 1688 ts_tablet_manager.cc:1367] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.088s user 0.014s sys 0.024s
I20240501 20:12:13.282552 1681 tablet_bootstrap.cc:654] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.283921 1680 tablet_bootstrap.cc:492] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.284066 1680 ts_tablet_manager.cc:1367] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.005s
I20240501 20:12:13.284874 1680 raft_consensus.cc:348] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.285342 1680 raft_consensus.cc:374] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.285456 1680 raft_consensus.cc:729] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.285342 1688 raft_consensus.cc:348] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.287571 1688 raft_consensus.cc:374] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.288663 1688 raft_consensus.cc:729] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.288923 1688 consensus_queue.cc:260] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.289621 1680 consensus_queue.cc:260] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.291716 1800 raft_consensus.cc:504] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.293498 1680 ts_tablet_manager.cc:1398] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20240501 20:12:13.294631 1688 ts_tablet_manager.cc:1398] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20240501 20:12:13.294559 1803 consensus_queue.cc:1035] T dd0c2f09e028435abb4a0660e637cefb P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240501 20:12:13.295732 1745 raft_consensus.cc:504] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.296577 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a1b45e9be5446cb5ad18906381d9fd" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.296814 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b62689a9a324b1293e98ef3d09f2419" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.298024 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b62689a9a324b1293e98ef3d09f2419" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.298107 1680 tablet_bootstrap.cc:492] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.297753 1800 leader_election.cc:288] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.298564 1745 leader_election.cc:288] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.299417 1688 tablet_bootstrap.cc:492] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
W20240501 20:12:13.299675 1457 leader_election.cc:341] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.298967 1564 raft_consensus.cc:3037] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.300266 1488 raft_consensus.cc:3037] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.301664 1680 tablet_bootstrap.cc:654] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.306178 1688 tablet_bootstrap.cc:654] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.309603 1688 tablet_bootstrap.cc:492] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.309552 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a1b45e9be5446cb5ad18906381d9fd" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.309754 1641 raft_consensus.cc:3037] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.309760 1688 ts_tablet_manager.cc:1367] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20240501 20:12:13.311236 1688 raft_consensus.cc:348] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.311452 1688 raft_consensus.cc:374] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.311548 1688 raft_consensus.cc:729] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.311766 1564 raft_consensus.cc:2454] T 0b62689a9a324b1293e98ef3d09f2419 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.312142 1606 leader_election.cc:302] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.309556 1680 tablet_bootstrap.cc:492] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.311810 1688 consensus_queue.cc:260] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.312580 1800 raft_consensus.cc:2781] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.312718 1800 raft_consensus.cc:686] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.313203 1680 ts_tablet_manager.cc:1367] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.004s
I20240501 20:12:13.313184 1641 raft_consensus.cc:2454] T d5a1b45e9be5446cb5ad18906381d9fd P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.313606 1457 leader_election.cc:302] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.313920 1688 ts_tablet_manager.cc:1398] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:12:13.313998 1745 raft_consensus.cc:2781] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.314162 1745 raft_consensus.cc:686] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.314211 1688 tablet_bootstrap.cc:492] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.314411 1745 consensus_queue.cc:237] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.314756 1803 raft_consensus.cc:482] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.314956 1803 raft_consensus.cc:504] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.315538 1803 leader_election.cc:288] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.315718 1688 tablet_bootstrap.cc:654] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.316083 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f379c9b447af4fb29e6081a1f9e901ec" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.316277 1492 raft_consensus.cc:2454] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.316744 1604 leader_election.cc:302] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.317463 1387 catalog_manager.cc:5484] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.318042 1387 catalog_manager.cc:5484] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.318269 1803 raft_consensus.cc:2781] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.318509 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f379c9b447af4fb29e6081a1f9e901ec" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.318608 1803 raft_consensus.cc:482] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.318903 1803 raft_consensus.cc:3037] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.320593 1488 raft_consensus.cc:2454] T 0b62689a9a324b1293e98ef3d09f2419 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.321496 1803 raft_consensus.cc:504] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.322366 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f379c9b447af4fb29e6081a1f9e901ec" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.322589 1488 raft_consensus.cc:3037] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.322624 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f379c9b447af4fb29e6081a1f9e901ec" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.323127 1606 leader_election.cc:341] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:13.323575 1606 leader_election.cc:341] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.323966 1803 leader_election.cc:288] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.324715 1564 raft_consensus.cc:3037] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.327229 1800 consensus_queue.cc:237] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.328089 1680 raft_consensus.cc:348] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.328311 1680 raft_consensus.cc:374] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.328334 1488 raft_consensus.cc:2454] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.328418 1680 raft_consensus.cc:729] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.328634 1680 consensus_queue.cc:260] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.328730 1604 leader_election.cc:302] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.329128 1793 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.329185 1704 raft_consensus.cc:2781] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.329615 1704 raft_consensus.cc:686] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.329888 1704 consensus_queue.cc:237] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.329214 1680 ts_tablet_manager.cc:1398] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20240501 20:12:13.331228 1680 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.332952 1680 tablet_bootstrap.cc:654] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.337653 1681 tablet_bootstrap.cc:492] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.337821 1681 ts_tablet_manager.cc:1367] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.006s
I20240501 20:12:13.338577 1681 raft_consensus.cc:348] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.338771 1681 raft_consensus.cc:374] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.338876 1681 raft_consensus.cc:729] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.339092 1681 consensus_queue.cc:260] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.339630 1681 ts_tablet_manager.cc:1398] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:13.339944 1681 tablet_bootstrap.cc:492] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.345290 1680 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.345505 1680 ts_tablet_manager.cc:1367] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.003s
I20240501 20:12:13.346279 1680 raft_consensus.cc:348] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.347045 1680 raft_consensus.cc:374] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.347147 1680 raft_consensus.cc:729] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.347466 1680 consensus_queue.cc:260] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.348068 1680 ts_tablet_manager.cc:1398] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:12:13.348346 1680 tablet_bootstrap.cc:492] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.348438 1799 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.349436 1681 tablet_bootstrap.cc:654] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.350159 1752 consensus_queue.cc:1035] T 599e699186cd4a8ebf71634a746d7f1a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.350353 1680 tablet_bootstrap.cc:654] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.351279 1389 catalog_manager.cc:5484] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.353313 1387 catalog_manager.cc:5484] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.354075 1680 tablet_bootstrap.cc:492] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.354213 1680 ts_tablet_manager.cc:1367] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20240501 20:12:13.354923 1680 raft_consensus.cc:348] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.355149 1680 raft_consensus.cc:374] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.355262 1680 raft_consensus.cc:729] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.355500 1680 consensus_queue.cc:260] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.356011 1680 ts_tablet_manager.cc:1398] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:13.356261 1680 tablet_bootstrap.cc:492] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.357844 1680 tablet_bootstrap.cc:654] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.359405 1390 catalog_manager.cc:5484] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.363214 1688 tablet_bootstrap.cc:492] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.363375 1688 ts_tablet_manager.cc:1367] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.049s user 0.019s sys 0.018s
I20240501 20:12:13.364161 1688 raft_consensus.cc:348] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.364368 1688 raft_consensus.cc:374] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.364468 1688 raft_consensus.cc:729] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.364720 1688 consensus_queue.cc:260] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.365259 1688 ts_tablet_manager.cc:1398] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 20:12:13.365723 1688 tablet_bootstrap.cc:492] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.367118 1688 tablet_bootstrap.cc:654] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.367884 1680 tablet_bootstrap.cc:492] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.368063 1680 ts_tablet_manager.cc:1367] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20240501 20:12:13.368810 1680 raft_consensus.cc:348] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.369035 1680 raft_consensus.cc:374] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.369153 1680 raft_consensus.cc:729] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.369416 1680 consensus_queue.cc:260] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.370023 1680 ts_tablet_manager.cc:1398] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:13.370389 1680 tablet_bootstrap.cc:492] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.370386 1681 tablet_bootstrap.cc:492] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.370580 1681 ts_tablet_manager.cc:1367] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.004s
I20240501 20:12:13.372030 1680 tablet_bootstrap.cc:654] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.372408 1681 raft_consensus.cc:348] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.373198 1681 raft_consensus.cc:374] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.373304 1681 raft_consensus.cc:729] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.373512 1681 consensus_queue.cc:260] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.375435 1688 tablet_bootstrap.cc:492] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.375622 1688 ts_tablet_manager.cc:1367] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20240501 20:12:13.376397 1681 ts_tablet_manager.cc:1398] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20240501 20:12:13.376425 1680 tablet_bootstrap.cc:492] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.376343 1688 raft_consensus.cc:348] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.376554 1688 raft_consensus.cc:374] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.376581 1680 ts_tablet_manager.cc:1367] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.001s
I20240501 20:12:13.376663 1688 raft_consensus.cc:729] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.376708 1681 tablet_bootstrap.cc:492] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.376892 1688 consensus_queue.cc:260] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.377463 1688 ts_tablet_manager.cc:1398] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:13.377800 1688 tablet_bootstrap.cc:492] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.378270 1681 tablet_bootstrap.cc:654] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.378307 1680 raft_consensus.cc:348] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.378522 1680 raft_consensus.cc:374] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.378636 1680 raft_consensus.cc:729] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.379101 1680 consensus_queue.cc:260] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.379362 1688 tablet_bootstrap.cc:654] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.379729 1680 ts_tablet_manager.cc:1398] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.381448 1680 tablet_bootstrap.cc:492] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.382939 1680 tablet_bootstrap.cc:654] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.385016 1799 consensus_queue.cc:1035] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.389262 1803 consensus_queue.cc:1035] T 055a0d2bb3c047aea3f375153145cb42 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.393317 1681 tablet_bootstrap.cc:492] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.393451 1681 ts_tablet_manager.cc:1367] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.005s
I20240501 20:12:13.394131 1681 raft_consensus.cc:348] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.394328 1681 raft_consensus.cc:374] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.394381 1681 raft_consensus.cc:729] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.394615 1704 raft_consensus.cc:482] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.394549 1681 consensus_queue.cc:260] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.394707 1704 raft_consensus.cc:504] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.395071 1681 ts_tablet_manager.cc:1398] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:13.395356 1681 tablet_bootstrap.cc:492] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.395457 1704 leader_election.cc:288] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.395700 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17b0ff3e282b40c9b3feb276bf62f02f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.395879 1488 raft_consensus.cc:2454] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.396142 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17b0ff3e282b40c9b3feb276bf62f02f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.396207 1604 leader_election.cc:302] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
W20240501 20:12:13.396577 1606 leader_election.cc:341] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.397086 1803 raft_consensus.cc:2781] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.397163 1803 raft_consensus.cc:482] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.397243 1803 raft_consensus.cc:3037] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.397891 1681 tablet_bootstrap.cc:654] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.399012 1688 tablet_bootstrap.cc:492] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.399139 1688 ts_tablet_manager.cc:1367] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.013s
I20240501 20:12:13.399597 1803 raft_consensus.cc:504] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.399770 1688 raft_consensus.cc:348] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.399935 1688 raft_consensus.cc:374] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.399998 1688 raft_consensus.cc:729] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.400171 1688 consensus_queue.cc:260] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.400638 1688 ts_tablet_manager.cc:1398] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:13.400707 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17b0ff3e282b40c9b3feb276bf62f02f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.400857 1566 raft_consensus.cc:3037] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.400903 1688 tablet_bootstrap.cc:492] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.401351 1803 leader_election.cc:288] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.402174 1688 tablet_bootstrap.cc:654] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.403367 1566 raft_consensus.cc:2454] T 17b0ff3e282b40c9b3feb276bf62f02f P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.403797 1606 leader_election.cc:302] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.404206 1696 raft_consensus.cc:2781] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.404354 1696 raft_consensus.cc:686] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.404601 1696 consensus_queue.cc:237] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.400871 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17b0ff3e282b40c9b3feb276bf62f02f" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.405784 1488 raft_consensus.cc:3037] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.408393 1680 tablet_bootstrap.cc:492] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.408519 1680 ts_tablet_manager.cc:1367] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.004s
I20240501 20:12:13.408598 1488 raft_consensus.cc:2454] T 17b0ff3e282b40c9b3feb276bf62f02f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.409989 1680 raft_consensus.cc:348] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.410127 1680 raft_consensus.cc:374] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.410176 1680 raft_consensus.cc:729] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.410353 1680 consensus_queue.cc:260] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.411370 1680 ts_tablet_manager.cc:1398] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.411576 1680 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.412556 1680 tablet_bootstrap.cc:654] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.423889 1680 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.424026 1680 ts_tablet_manager.cc:1367] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s
I20240501 20:12:13.423928 1387 catalog_manager.cc:5484] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.424551 1680 raft_consensus.cc:348] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.424683 1680 raft_consensus.cc:374] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.424732 1680 raft_consensus.cc:729] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.424911 1680 consensus_queue.cc:260] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.425393 1680 ts_tablet_manager.cc:1398] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 20:12:13.425623 1680 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.425987 1681 tablet_bootstrap.cc:492] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.426105 1681 ts_tablet_manager.cc:1367] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.000s
I20240501 20:12:13.427119 1680 tablet_bootstrap.cc:654] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.426760 1681 raft_consensus.cc:348] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.428520 1680 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.428632 1680 ts_tablet_manager.cc:1367] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.428452 1681 raft_consensus.cc:374] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.428716 1681 raft_consensus.cc:729] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.428994 1681 consensus_queue.cc:260] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.429612 1681 ts_tablet_manager.cc:1398] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.430016 1681 tablet_bootstrap.cc:492] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.429203 1680 raft_consensus.cc:348] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.431679 1680 raft_consensus.cc:374] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.431739 1680 raft_consensus.cc:729] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.431908 1680 consensus_queue.cc:260] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.432449 1680 ts_tablet_manager.cc:1398] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:12:13.432670 1680 tablet_bootstrap.cc:492] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.433497 1696 consensus_queue.cc:1035] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.435688 1681 tablet_bootstrap.cc:654] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.437381 1688 tablet_bootstrap.cc:492] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.437500 1688 ts_tablet_manager.cc:1367] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.037s user 0.015s sys 0.019s
I20240501 20:12:13.437978 1688 raft_consensus.cc:348] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.438107 1688 raft_consensus.cc:374] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.438156 1688 raft_consensus.cc:729] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.438328 1688 consensus_queue.cc:260] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.438500 1680 tablet_bootstrap.cc:654] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.439533 1688 ts_tablet_manager.cc:1398] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 20:12:13.439775 1688 tablet_bootstrap.cc:492] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.441859 1680 tablet_bootstrap.cc:492] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.441975 1688 tablet_bootstrap.cc:654] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.442077 1680 ts_tablet_manager.cc:1367] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20240501 20:12:13.442714 1680 raft_consensus.cc:348] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.442942 1680 raft_consensus.cc:374] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.443035 1680 raft_consensus.cc:729] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.443377 1681 tablet_bootstrap.cc:492] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.443274 1680 consensus_queue.cc:260] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.443506 1681 ts_tablet_manager.cc:1367] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20240501 20:12:13.443863 1680 ts_tablet_manager.cc:1398] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:13.443969 1681 raft_consensus.cc:348] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.444145 1681 raft_consensus.cc:374] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.444193 1680 tablet_bootstrap.cc:492] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.444197 1681 raft_consensus.cc:729] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.444687 1681 consensus_queue.cc:260] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.445149 1681 ts_tablet_manager.cc:1398] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:13.445379 1681 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.445828 1688 tablet_bootstrap.cc:492] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.445907 1688 ts_tablet_manager.cc:1367] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20240501 20:12:13.446311 1688 raft_consensus.cc:348] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.446427 1688 raft_consensus.cc:374] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.446456 1688 raft_consensus.cc:729] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.446592 1688 consensus_queue.cc:260] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.446769 1681 tablet_bootstrap.cc:654] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.447158 1688 ts_tablet_manager.cc:1398] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 20:12:13.447383 1688 tablet_bootstrap.cc:492] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.449226 1564 raft_consensus.cc:3037] T c13c2438cee84fcc9d98256bbf641222 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.449371 1688 tablet_bootstrap.cc:654] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.449470 1680 tablet_bootstrap.cc:654] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.455866 1688 tablet_bootstrap.cc:492] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.456020 1688 ts_tablet_manager.cc:1367] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20240501 20:12:13.456411 1696 consensus_queue.cc:1035] T c13c2438cee84fcc9d98256bbf641222 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.456526 1681 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.456629 1681 ts_tablet_manager.cc:1367] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20240501 20:12:13.456758 1688 raft_consensus.cc:348] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.456952 1688 raft_consensus.cc:374] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.457064 1688 raft_consensus.cc:729] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.457214 1681 raft_consensus.cc:348] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.457358 1681 raft_consensus.cc:374] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.457412 1681 raft_consensus.cc:729] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.457504 1688 consensus_queue.cc:260] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.457571 1681 consensus_queue.cc:260] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.458048 1688 ts_tablet_manager.cc:1398] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:13.458319 1688 tablet_bootstrap.cc:492] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.460364 1680 tablet_bootstrap.cc:492] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.460492 1680 ts_tablet_manager.cc:1367] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20240501 20:12:13.460496 1688 tablet_bootstrap.cc:654] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.460579 1681 ts_tablet_manager.cc:1398] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:12:13.461163 1680 raft_consensus.cc:348] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.461350 1680 raft_consensus.cc:374] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.461405 1680 raft_consensus.cc:729] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.461608 1680 consensus_queue.cc:260] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.462045 1680 ts_tablet_manager.cc:1398] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 20:12:13.462353 1680 tablet_bootstrap.cc:492] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.463498 1681 tablet_bootstrap.cc:492] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.463814 1680 tablet_bootstrap.cc:654] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.465126 1681 tablet_bootstrap.cc:654] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.471035 1688 tablet_bootstrap.cc:492] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.471302 1688 ts_tablet_manager.cc:1367] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20240501 20:12:13.472098 1688 raft_consensus.cc:348] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.472491 1688 raft_consensus.cc:374] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.472587 1688 raft_consensus.cc:729] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.472898 1688 consensus_queue.cc:260] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.473506 1688 ts_tablet_manager.cc:1398] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:13.473816 1688 tablet_bootstrap.cc:492] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.474946 1680 tablet_bootstrap.cc:492] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.475090 1680 ts_tablet_manager.cc:1367] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20240501 20:12:13.475662 1688 tablet_bootstrap.cc:654] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.475688 1680 raft_consensus.cc:348] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.475857 1680 raft_consensus.cc:374] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.475915 1680 raft_consensus.cc:729] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.476104 1680 consensus_queue.cc:260] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.476670 1680 ts_tablet_manager.cc:1398] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:13.476902 1680 tablet_bootstrap.cc:492] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.478304 1680 tablet_bootstrap.cc:654] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.479650 1696 raft_consensus.cc:482] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.479795 1696 raft_consensus.cc:504] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.480079 1681 tablet_bootstrap.cc:492] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.480211 1681 ts_tablet_manager.cc:1367] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.017s user 0.016s sys 0.000s
I20240501 20:12:13.480417 1696 leader_election.cc:288] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.480695 1680 tablet_bootstrap.cc:492] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.480809 1680 ts_tablet_manager.cc:1367] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 20:12:13.480842 1681 raft_consensus.cc:348] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.480911 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e32716adda49f9b25a5cad3ed195b9" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.481012 1681 raft_consensus.cc:374] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.481083 1681 raft_consensus.cc:729] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.481269 1681 consensus_queue.cc:260] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
W20240501 20:12:13.481420 1604 leader_election.cc:341] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.481395 1680 raft_consensus.cc:348] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.481601 1680 raft_consensus.cc:374] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.481663 1680 raft_consensus.cc:729] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.481920 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e32716adda49f9b25a5cad3ed195b9" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:13.482362 1606 leader_election.cc:341] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.482468 1606 leader_election.cc:302] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.482815 1696 raft_consensus.cc:2726] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.483007 1680 consensus_queue.cc:260] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.483634 1680 ts_tablet_manager.cc:1398] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.483897 1680 tablet_bootstrap.cc:492] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.484773 1681 ts_tablet_manager.cc:1398] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 20:12:13.485538 1680 tablet_bootstrap.cc:654] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.487915 1681 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.491660 1681 tablet_bootstrap.cc:654] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.496675 1688 tablet_bootstrap.cc:492] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.496901 1688 ts_tablet_manager.cc:1367] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.013s
I20240501 20:12:13.497553 1688 raft_consensus.cc:348] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.497741 1688 raft_consensus.cc:374] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.497802 1688 raft_consensus.cc:729] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.497833 1680 tablet_bootstrap.cc:492] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.497954 1680 ts_tablet_manager.cc:1367] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.007s
I20240501 20:12:13.497954 1681 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.498000 1688 consensus_queue.cc:260] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.498162 1681 ts_tablet_manager.cc:1367] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20240501 20:12:13.498597 1688 ts_tablet_manager.cc:1398] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:13.498522 1680 raft_consensus.cc:348] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.498690 1680 raft_consensus.cc:374] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.498742 1680 raft_consensus.cc:729] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.498718 1681 raft_consensus.cc:348] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.498862 1681 raft_consensus.cc:374] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.498912 1681 raft_consensus.cc:729] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.499023 1688 tablet_bootstrap.cc:492] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.498914 1680 consensus_queue.cc:260] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.499118 1681 consensus_queue.cc:260] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.499388 1756 raft_consensus.cc:482] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.499486 1756 raft_consensus.cc:504] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.500059 1756 leader_election.cc:288] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.500530 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34308521f7b7481fafef0344fec556f2" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.500682 1488 raft_consensus.cc:2454] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:13.501356 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34308521f7b7481fafef0344fec556f2" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.501518 1641 raft_consensus.cc:2454] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:13.501868 1530 leader_election.cc:302] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.502220 1756 raft_consensus.cc:2781] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.502264 1681 ts_tablet_manager.cc:1398] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:13.502298 1756 raft_consensus.cc:482] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.502372 1756 raft_consensus.cc:3037] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.502530 1680 ts_tablet_manager.cc:1398] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 20:12:13.502789 1680 tablet_bootstrap.cc:492] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.504354 1680 tablet_bootstrap.cc:654] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.505095 1756 raft_consensus.cc:504] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.505975 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34308521f7b7481fafef0344fec556f2" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.506134 1488 raft_consensus.cc:3037] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.506246 1681 tablet_bootstrap.cc:492] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.507812 1681 tablet_bootstrap.cc:654] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.508129 1699 raft_consensus.cc:482] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.508239 1699 raft_consensus.cc:504] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.508755 1699 leader_election.cc:288] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.508821 1488 raft_consensus.cc:2454] T 34308521f7b7481fafef0344fec556f2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:13.509302 1756 leader_election.cc:288] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.509369 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c95b72ede9fc487b87490e2d4a75e261" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.509552 1564 raft_consensus.cc:2454] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.509938 1457 leader_election.cc:302] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.510202 1699 raft_consensus.cc:2781] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.510263 1699 raft_consensus.cc:482] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.510316 1699 raft_consensus.cc:3037] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.510668 1688 tablet_bootstrap.cc:654] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.513231 1699 raft_consensus.cc:504] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.513886 1699 leader_election.cc:288] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.514243 1688 tablet_bootstrap.cc:492] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.514369 1688 ts_tablet_manager.cc:1367] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20240501 20:12:13.514493 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c95b72ede9fc487b87490e2d4a75e261" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.514674 1564 raft_consensus.cc:3037] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.515018 1688 raft_consensus.cc:348] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.515205 1688 raft_consensus.cc:374] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.515339 1688 raft_consensus.cc:729] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.515533 1688 consensus_queue.cc:260] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.517200 1688 ts_tablet_manager.cc:1398] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:12:13.517472 1688 tablet_bootstrap.cc:492] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.517654 1564 raft_consensus.cc:2454] T c95b72ede9fc487b87490e2d4a75e261 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.518366 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c95b72ede9fc487b87490e2d4a75e261" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.518553 1641 raft_consensus.cc:2454] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.518807 1638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c95b72ede9fc487b87490e2d4a75e261" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.518936 1638 raft_consensus.cc:3037] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.519228 1688 tablet_bootstrap.cc:654] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.521173 1793 raft_consensus.cc:482] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.521256 1793 raft_consensus.cc:504] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.521770 1680 tablet_bootstrap.cc:492] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.521800 1793 leader_election.cc:288] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.521893 1680 ts_tablet_manager.cc:1367] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.005s
I20240501 20:12:13.522101 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a3e65d25d74d469efe3fdd86b6e360" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.522249 1488 raft_consensus.cc:2454] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.522300 1681 tablet_bootstrap.cc:492] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.522435 1681 ts_tablet_manager.cc:1367] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20240501 20:12:13.522514 1530 leader_election.cc:302] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.522481 1680 raft_consensus.cc:348] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.522637 1680 raft_consensus.cc:374] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.522619 1604 leader_election.cc:302] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.522683 1680 raft_consensus.cc:729] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.522810 1457 leader_election.cc:302] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.522934 1696 raft_consensus.cc:2781] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.522987 1696 raft_consensus.cc:482] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.522898 1680 consensus_queue.cc:260] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.522835 1756 raft_consensus.cc:2781] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.523115 1756 raft_consensus.cc:686] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:13.523355 1680 ts_tablet_manager.cc:1398] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:13.523308 1756 consensus_queue.cc:237] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.523588 1680 tablet_bootstrap.cc:492] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.523974 1700 raft_consensus.cc:482] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.524089 1700 raft_consensus.cc:504] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.524408 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a3e65d25d74d469efe3fdd86b6e360" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.524546 1566 raft_consensus.cc:2454] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.524614 1700 leader_election.cc:288] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.523043 1696 raft_consensus.cc:3037] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.524966 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34308521f7b7481fafef0344fec556f2" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.525127 1641 raft_consensus.cc:3037] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.525106 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6c65585f2c40c5bc072744c8b7b183" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.525139 1680 tablet_bootstrap.cc:654] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.525883 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6c65585f2c40c5bc072744c8b7b183" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.526118 1489 raft_consensus.cc:2379] T 7f6c65585f2c40c5bc072744c8b7b183 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:13.527478 1696 raft_consensus.cc:504] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.527659 1641 raft_consensus.cc:2454] T 34308521f7b7481fafef0344fec556f2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:13.527983 1696 leader_election.cc:288] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.528501 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a3e65d25d74d469efe3fdd86b6e360" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.528671 1566 raft_consensus.cc:3037] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.529675 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a3e65d25d74d469efe3fdd86b6e360" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.529843 1488 raft_consensus.cc:3037] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.523038 1681 raft_consensus.cc:348] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.530612 1681 raft_consensus.cc:374] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.530678 1681 raft_consensus.cc:729] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.530875 1681 consensus_queue.cc:260] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.531365 1566 raft_consensus.cc:2454] T 19a3e65d25d74d469efe3fdd86b6e360 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.531805 1745 raft_consensus.cc:2781] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.531822 1606 leader_election.cc:302] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.531932 1745 raft_consensus.cc:686] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.532132 1745 consensus_queue.cc:237] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.532698 1488 raft_consensus.cc:2454] T 19a3e65d25d74d469efe3fdd86b6e360 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.533380 1793 raft_consensus.cc:2781] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.533504 1793 raft_consensus.cc:686] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.533710 1793 consensus_queue.cc:237] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.534183 1681 ts_tablet_manager.cc:1398] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20240501 20:12:13.534400 1681 tablet_bootstrap.cc:492] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.535192 1532 leader_election.cc:302] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:13.535804 1700 raft_consensus.cc:3037] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.536063 1681 tablet_bootstrap.cc:654] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.536110 1390 catalog_manager.cc:5484] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.538627 1700 raft_consensus.cc:2726] T 7f6c65585f2c40c5bc072744c8b7b183 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.541836 1638 raft_consensus.cc:2454] T c95b72ede9fc487b87490e2d4a75e261 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.541832 1688 tablet_bootstrap.cc:492] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.542130 1688 ts_tablet_manager.cc:1367] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20240501 20:12:13.542837 1688 raft_consensus.cc:348] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.543018 1688 raft_consensus.cc:374] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.543063 1688 raft_consensus.cc:729] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.543278 1688 consensus_queue.cc:260] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.543759 1688 ts_tablet_manager.cc:1398] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:13.544011 1688 tablet_bootstrap.cc:492] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.544569 1699 consensus_queue.cc:1035] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.546427 1680 tablet_bootstrap.cc:492] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.546545 1680 ts_tablet_manager.cc:1367] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.013s
I20240501 20:12:13.547158 1680 raft_consensus.cc:348] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.547340 1680 raft_consensus.cc:374] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.547416 1680 raft_consensus.cc:729] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.547336 1387 catalog_manager.cc:5484] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.547610 1680 consensus_queue.cc:260] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.548048 1680 ts_tablet_manager.cc:1398] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 20:12:13.547935 1390 catalog_manager.cc:5484] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.548310 1680 tablet_bootstrap.cc:492] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.548341 1793 raft_consensus.cc:482] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.548424 1793 raft_consensus.cc:504] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.548971 1793 leader_election.cc:288] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.549062 1800 raft_consensus.cc:482] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.549243 1800 raft_consensus.cc:504] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.549705 1688 tablet_bootstrap.cc:654] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.549770 1800 leader_election.cc:288] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.549942 1680 tablet_bootstrap.cc:654] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.553382 1799 raft_consensus.cc:482] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.553529 1799 raft_consensus.cc:504] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.553968 1681 tablet_bootstrap.cc:492] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.554286 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873087761cda482f8756584663220652" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.551084 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873087761cda482f8756584663220652" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:13.554968 1606 leader_election.cc:341] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:13.555348 1604 leader_election.cc:341] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.555765 1799 leader_election.cc:288] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.553699 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.556753 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.557353 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41682f6de504ad78a616818b19493bc" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.557973 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41682f6de504ad78a616818b19493bc" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.558192 1604 leader_election.cc:302] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.558434 1799 raft_consensus.cc:2726] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240501 20:12:13.558751 1606 leader_election.cc:341] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:13.559142 1606 leader_election.cc:341] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.560194 1688 tablet_bootstrap.cc:492] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
W20240501 20:12:13.560992 1604 leader_election.cc:341] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.561478 1681 ts_tablet_manager.cc:1367] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20240501 20:12:13.562295 1488 raft_consensus.cc:2454] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.562331 1699 consensus_queue.cc:1035] T d88af9fa98d343d4a1f00181f0eb5162 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240501 20:12:13.562584 1688 ts_tablet_manager.cc:1367] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20240501 20:12:13.562716 1604 leader_election.cc:302] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.563122 1604 leader_election.cc:302] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.563310 1688 raft_consensus.cc:348] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.563437 1696 raft_consensus.cc:2726] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.563514 1688 raft_consensus.cc:374] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.563609 1688 raft_consensus.cc:729] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.563614 1696 raft_consensus.cc:2781] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.563788 1696 raft_consensus.cc:482] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.563886 1696 raft_consensus.cc:3037] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.563980 1680 tablet_bootstrap.cc:492] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
I20240501 20:12:13.563947 1688 consensus_queue.cc:260] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.564126 1680 ts_tablet_manager.cc:1367] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.008s
I20240501 20:12:13.564474 1688 ts_tablet_manager.cc:1398] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:13.564770 1688 tablet_bootstrap.cc:492] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.564810 1680 raft_consensus.cc:348] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.565014 1680 raft_consensus.cc:374] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.565613 1680 raft_consensus.cc:729] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.565876 1680 consensus_queue.cc:260] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.566408 1680 ts_tablet_manager.cc:1398] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 20:12:13.566715 1680 tablet_bootstrap.cc:492] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b: Bootstrap starting.
I20240501 20:12:13.566857 1688 tablet_bootstrap.cc:654] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.567854 1696 raft_consensus.cc:504] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.568222 1680 tablet_bootstrap.cc:654] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.568710 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41682f6de504ad78a616818b19493bc" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.568904 1488 raft_consensus.cc:3037] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.571800 1488 raft_consensus.cc:2454] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.572214 1604 leader_election.cc:302] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.572544 1799 raft_consensus.cc:2781] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.572674 1799 raft_consensus.cc:686] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.572957 1799 consensus_queue.cc:237] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.576274 1696 leader_election.cc:288] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.576789 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41682f6de504ad78a616818b19493bc" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.577322 1606 leader_election.cc:341] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.563439 1681 raft_consensus.cc:348] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.579185 1681 raft_consensus.cc:374] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.579282 1681 raft_consensus.cc:729] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.579506 1681 consensus_queue.cc:260] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.580816 1696 raft_consensus.cc:482] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.580958 1696 raft_consensus.cc:504] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.581954 1696 leader_election.cc:288] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.582425 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925e23a6cc4c3e9fbb3b33cf39d72a" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:13.582873 1606 leader_election.cc:341] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.584805 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925e23a6cc4c3e9fbb3b33cf39d72a" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.585011 1488 raft_consensus.cc:2454] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.585369 1604 leader_election.cc:302] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.585803 1696 raft_consensus.cc:2781] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.585937 1696 raft_consensus.cc:482] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.586033 1696 raft_consensus.cc:3037] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.587757 1565 raft_consensus.cc:3037] T dd0c2f09e028435abb4a0660e637cefb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.589637 1696 raft_consensus.cc:504] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.590632 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925e23a6cc4c3e9fbb3b33cf39d72a" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.590814 1488 raft_consensus.cc:3037] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.594101 1488 raft_consensus.cc:2454] T 43925e23a6cc4c3e9fbb3b33cf39d72a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.594588 1604 leader_election.cc:302] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.594904 1800 raft_consensus.cc:2781] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.595055 1800 raft_consensus.cc:686] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.595162 1681 ts_tablet_manager.cc:1398] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20240501 20:12:13.595355 1800 consensus_queue.cc:237] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.596747 1831 raft_consensus.cc:482] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.597391 1681 tablet_bootstrap.cc:492] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.597440 1831 raft_consensus.cc:504] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.598007 1831 leader_election.cc:288] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.599942 1831 raft_consensus.cc:482] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.600080 1831 raft_consensus.cc:504] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.601292 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f37d944d0d844828f7d97eeac371d0a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.601516 1641 raft_consensus.cc:2454] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.602035 1696 leader_election.cc:288] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.602250 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a961f26ce8d04b78a0e7d25fe8bbdfeb" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.605448 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a961f26ce8d04b78a0e7d25fe8bbdfeb" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.605691 1831 leader_election.cc:288] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.605901 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43925e23a6cc4c3e9fbb3b33cf39d72a" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.606302 1457 leader_election.cc:341] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.606534 1457 leader_election.cc:302] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.606786 1831 raft_consensus.cc:2781] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.606984 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f37d944d0d844828f7d97eeac371d0a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.608304 1831 raft_consensus.cc:482] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.608445 1641 raft_consensus.cc:2454] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
W20240501 20:12:13.611158 1457 leader_election.cc:341] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:13.612632 1606 leader_election.cc:341] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.613127 1831 raft_consensus.cc:3037] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.613849 1457 leader_election.cc:302] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.614146 1752 raft_consensus.cc:2781] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.615063 1752 raft_consensus.cc:482] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.615186 1752 raft_consensus.cc:3037] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.617935 1752 raft_consensus.cc:504] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.618579 1752 leader_election.cc:288] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.618579 1681 tablet_bootstrap.cc:654] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.619849 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a961f26ce8d04b78a0e7d25fe8bbdfeb" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.619906 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a961f26ce8d04b78a0e7d25fe8bbdfeb" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.620183 1641 raft_consensus.cc:3037] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.620733 1680 tablet_bootstrap.cc:492] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b: No bootstrap required, opened a new log
W20240501 20:12:13.621027 1457 leader_election.cc:341] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.622735 1680 ts_tablet_manager.cc:1367] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b: Time spent bootstrapping tablet: real 0.054s user 0.012s sys 0.027s
I20240501 20:12:13.623131 1752 raft_consensus.cc:482] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.623597 1752 raft_consensus.cc:504] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.624455 1752 leader_election.cc:288] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.624771 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c98df9e665f744c88e3edd852ee06f96" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.627131 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c98df9e665f744c88e3edd852ee06f96" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.627131 1640 raft_consensus.cc:2454] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.627743 1457 leader_election.cc:302] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.627738 1566 raft_consensus.cc:2454] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.628808 1752 raft_consensus.cc:2781] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.629474 1752 raft_consensus.cc:482] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.630762 1831 raft_consensus.cc:504] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.631613 1752 raft_consensus.cc:3037] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.631592 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f37d944d0d844828f7d97eeac371d0a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.632270 1831 leader_election.cc:288] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.632364 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f37d944d0d844828f7d97eeac371d0a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.633854 1799 raft_consensus.cc:482] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240501 20:12:13.633879 1457 leader_election.cc:341] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.634613 1640 raft_consensus.cc:3037] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.635560 1799 raft_consensus.cc:504] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.636196 1799 leader_election.cc:288] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.636461 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd28f411966a432aa3a8cca7076c3ca7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.637879 1488 raft_consensus.cc:2454] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.637885 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd28f411966a432aa3a8cca7076c3ca7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.632444 1680 raft_consensus.cc:348] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.638999 1680 raft_consensus.cc:374] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.638851 1604 leader_election.cc:302] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.638356 1387 catalog_manager.cc:5484] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.638849 1641 raft_consensus.cc:2454] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
W20240501 20:12:13.639952 1606 leader_election.cc:341] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.640652 1799 raft_consensus.cc:2781] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.640810 1799 raft_consensus.cc:482] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.640827 1457 leader_election.cc:302] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.641696 1680 raft_consensus.cc:729] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.642671 1799 raft_consensus.cc:3037] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.643870 1688 tablet_bootstrap.cc:492] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.644192 1640 raft_consensus.cc:2454] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.644196 1831 raft_consensus.cc:2781] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.644469 1831 raft_consensus.cc:686] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.644627 1680 consensus_queue.cc:260] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.645201 1681 tablet_bootstrap.cc:492] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.645323 1457 leader_election.cc:302] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.645370 1681 ts_tablet_manager.cc:1367] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.004s
I20240501 20:12:13.645551 1688 ts_tablet_manager.cc:1367] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.079s user 0.033s sys 0.030s
I20240501 20:12:13.647046 1680 ts_tablet_manager.cc:1398] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20240501 20:12:13.647079 1685 raft_consensus.cc:2781] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.647229 1685 raft_consensus.cc:686] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.647491 1685 consensus_queue.cc:237] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.648056 1752 raft_consensus.cc:504] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.648186 1799 raft_consensus.cc:504] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.648936 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c98df9e665f744c88e3edd852ee06f96" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.649025 1799 leader_election.cc:288] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.649160 1565 raft_consensus.cc:3037] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.649892 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd28f411966a432aa3a8cca7076c3ca7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.650583 1488 raft_consensus.cc:3037] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.650578 1681 raft_consensus.cc:348] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.650888 1681 raft_consensus.cc:374] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.651026 1681 raft_consensus.cc:729] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.651487 1681 consensus_queue.cc:260] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.651466 1387 catalog_manager.cc:5484] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.652204 1565 raft_consensus.cc:2454] T c98df9e665f744c88e3edd852ee06f96 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.652261 1681 ts_tablet_manager.cc:1398] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240501 20:12:13.652587 1457 leader_election.cc:302] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.652647 1681 tablet_bootstrap.cc:492] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.652864 1685 raft_consensus.cc:2781] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.653029 1685 raft_consensus.cc:686] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.653203 1488 raft_consensus.cc:2454] T fd28f411966a432aa3a8cca7076c3ca7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.653280 1685 consensus_queue.cc:237] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.653699 1604 leader_election.cc:302] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.653990 1800 raft_consensus.cc:2781] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.654142 1800 raft_consensus.cc:686] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.654266 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd28f411966a432aa3a8cca7076c3ca7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.654368 1800 consensus_queue.cc:237] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.654608 1831 consensus_queue.cc:237] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
W20240501 20:12:13.654753 1606 leader_election.cc:341] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.655177 1799 consensus_queue.cc:1035] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.658633 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c98df9e665f744c88e3edd852ee06f96" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.658843 1640 raft_consensus.cc:3037] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.659691 1681 tablet_bootstrap.cc:654] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.661208 1688 raft_consensus.cc:348] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.661427 1688 raft_consensus.cc:374] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.661521 1688 raft_consensus.cc:729] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.662052 1640 raft_consensus.cc:2454] T c98df9e665f744c88e3edd852ee06f96 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.662629 1752 leader_election.cc:288] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.661732 1688 consensus_queue.cc:260] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.663264 1688 ts_tablet_manager.cc:1398] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20240501 20:12:13.663568 1688 tablet_bootstrap.cc:492] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.665467 1688 tablet_bootstrap.cc:654] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.671164 1700 raft_consensus.cc:482] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.671238 1387 catalog_manager.cc:5484] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.671762 1700 raft_consensus.cc:504] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.672459 1700 leader_election.cc:288] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.673472 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599e699186cd4a8ebf71634a746d7f1a" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.673866 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599e699186cd4a8ebf71634a746d7f1a" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.674266 1532 leader_election.cc:302] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:13.674798 1700 raft_consensus.cc:2726] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.676175 1389 catalog_manager.cc:5484] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.677688 1681 tablet_bootstrap.cc:492] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.677893 1681 ts_tablet_manager.cc:1367] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.009s
I20240501 20:12:13.678687 1681 raft_consensus.cc:348] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.678910 1681 raft_consensus.cc:374] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.678992 1681 raft_consensus.cc:729] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.679240 1681 consensus_queue.cc:260] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.679898 1681 ts_tablet_manager.cc:1398] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:13.680234 1681 tablet_bootstrap.cc:492] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.683085 1704 consensus_queue.cc:1035] T 7f6c65585f2c40c5bc072744c8b7b183 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.683251 1681 tablet_bootstrap.cc:654] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.685526 1688 tablet_bootstrap.cc:492] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.685708 1688 ts_tablet_manager.cc:1367] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.008s
I20240501 20:12:13.686771 1688 raft_consensus.cc:348] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.687003 1688 raft_consensus.cc:374] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.687084 1688 raft_consensus.cc:729] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.687292 1688 consensus_queue.cc:260] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.687929 1688 ts_tablet_manager.cc:1398] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:12:13.688232 1688 tablet_bootstrap.cc:492] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.689503 1752 consensus_queue.cc:1035] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.689548 1389 catalog_manager.cc:5484] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.689846 1688 tablet_bootstrap.cc:654] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.690114 1389 catalog_manager.cc:5484] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.693002 1681 tablet_bootstrap.cc:492] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.693159 1681 ts_tablet_manager.cc:1367] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.006s
I20240501 20:12:13.693434 1688 tablet_bootstrap.cc:492] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.693562 1688 ts_tablet_manager.cc:1367] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 20:12:13.693949 1681 raft_consensus.cc:348] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.694159 1681 raft_consensus.cc:374] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.694726 1681 raft_consensus.cc:729] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.694998 1752 consensus_queue.cc:1035] T f3da872ddf5d48e1a7c2f7f297a93bb1 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.695050 1704 raft_consensus.cc:482] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.695279 1704 raft_consensus.cc:504] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.695869 1704 leader_election.cc:288] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.696676 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c51e1cc64e4cc9bd2dc97403a28759" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.695133 1681 consensus_queue.cc:260] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.697070 1688 raft_consensus.cc:348] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.697238 1688 raft_consensus.cc:374] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.697350 1704 raft_consensus.cc:482] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240501 20:12:13.697355 1604 leader_election.cc:341] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.697503 1704 raft_consensus.cc:504] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.697948 1704 leader_election.cc:288] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.698276 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9178c194e31432eb382d89615c2c7d7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.698307 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9178c194e31432eb382d89615c2c7d7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.698638 1681 ts_tablet_manager.cc:1398] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 20:12:13.698704 1752 consensus_queue.cc:1035] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.698944 1681 tablet_bootstrap.cc:492] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
W20240501 20:12:13.698968 1604 leader_election.cc:341] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): Illegal state: must be running to vote when last-logged opid is not known
W20240501 20:12:13.699334 1606 leader_election.cc:341] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.699467 1606 leader_election.cc:302] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.700340 1803 raft_consensus.cc:2726] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.700562 1681 tablet_bootstrap.cc:654] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.701481 1688 raft_consensus.cc:729] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.701758 1688 consensus_queue.cc:260] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.702474 1688 ts_tablet_manager.cc:1398] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 20:12:13.702761 1688 tablet_bootstrap.cc:492] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.704527 1688 tablet_bootstrap.cc:654] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.706511 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c51e1cc64e4cc9bd2dc97403a28759" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:13.707304 1606 leader_election.cc:341] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.707463 1606 leader_election.cc:302] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b9f2e003064a248d8822d0ea062b6b; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.707705 1803 raft_consensus.cc:2726] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.707901 1756 raft_consensus.cc:482] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.708034 1756 raft_consensus.cc:504] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.708693 1756 leader_election.cc:288] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.709112 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd7cfd1931740538e0225f4ae54a11b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.709510 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd7cfd1931740538e0225f4ae54a11b" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.710194 1532 leader_election.cc:302] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:13.710676 1756 raft_consensus.cc:2726] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.711535 1681 tablet_bootstrap.cc:492] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.711760 1681 ts_tablet_manager.cc:1367] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20240501 20:12:13.712180 1831 raft_consensus.cc:482] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.712352 1831 raft_consensus.cc:504] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.713413 1831 leader_election.cc:288] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.714341 1681 raft_consensus.cc:348] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.714705 1681 raft_consensus.cc:374] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.714830 1681 raft_consensus.cc:729] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.715039 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe821f07300b4cc4a3e616b989b8592f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.715265 1641 raft_consensus.cc:2454] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.715665 1457 leader_election.cc:302] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.715999 1831 raft_consensus.cc:2781] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.716114 1831 raft_consensus.cc:482] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.716297 1831 raft_consensus.cc:3037] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.716862 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe821f07300b4cc4a3e616b989b8592f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.717082 1565 raft_consensus.cc:2454] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.718676 1831 raft_consensus.cc:504] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.715167 1681 consensus_queue.cc:260] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.722066 1681 ts_tablet_manager.cc:1398] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20240501 20:12:13.722759 1681 tablet_bootstrap.cc:492] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.723120 1688 tablet_bootstrap.cc:492] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.723250 1688 ts_tablet_manager.cc:1367] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.012s
I20240501 20:12:13.723958 1688 raft_consensus.cc:348] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.724119 1688 raft_consensus.cc:374] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.724184 1688 raft_consensus.cc:729] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.724385 1688 consensus_queue.cc:260] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.724571 1681 tablet_bootstrap.cc:654] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.726796 1565 raft_consensus.cc:3037] T 2cd7cfd1931740538e0225f4ae54a11b P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.727327 1688 ts_tablet_manager.cc:1398] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:13.727596 1688 tablet_bootstrap.cc:492] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.729245 1688 tablet_bootstrap.cc:654] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.730020 1752 consensus_queue.cc:1035] T 2cd7cfd1931740538e0225f4ae54a11b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.738852 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe821f07300b4cc4a3e616b989b8592f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.739223 1564 raft_consensus.cc:3037] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.740280 1803 raft_consensus.cc:482] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.740397 1803 raft_consensus.cc:504] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.740624 1688 tablet_bootstrap.cc:492] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.740757 1688 ts_tablet_manager.cc:1367] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20240501 20:12:13.740954 1803 leader_election.cc:288] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.741393 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f2a248c4924e539a7faea914ed64b7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.741464 1688 raft_consensus.cc:348] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.741564 1489 raft_consensus.cc:2454] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.741688 1564 raft_consensus.cc:2454] T fe821f07300b4cc4a3e616b989b8592f P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.741957 1604 leader_election.cc:302] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.742004 1457 leader_election.cc:302] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.742004 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f2a248c4924e539a7faea914ed64b7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.742188 1565 raft_consensus.cc:2454] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.742247 1803 raft_consensus.cc:2781] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.742326 1803 raft_consensus.cc:482] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.742388 1803 raft_consensus.cc:3037] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.742542 1831 leader_election.cc:288] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.742827 1688 raft_consensus.cc:374] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.742260 1752 raft_consensus.cc:2781] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.742944 1688 raft_consensus.cc:729] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.743038 1752 raft_consensus.cc:686] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.743218 1688 consensus_queue.cc:260] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.743281 1752 consensus_queue.cc:237] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.743477 1681 tablet_bootstrap.cc:492] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.743630 1681 ts_tablet_manager.cc:1367] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.008s
I20240501 20:12:13.743868 1688 ts_tablet_manager.cc:1398] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.744143 1688 tablet_bootstrap.cc:492] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.742800 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe821f07300b4cc4a3e616b989b8592f" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.744297 1640 raft_consensus.cc:3037] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.744664 1803 raft_consensus.cc:504] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.745260 1803 leader_election.cc:288] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.745729 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f2a248c4924e539a7faea914ed64b7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.745880 1489 raft_consensus.cc:3037] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.745975 1688 tablet_bootstrap.cc:654] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.746905 1640 raft_consensus.cc:2454] T fe821f07300b4cc4a3e616b989b8592f P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.744285 1681 raft_consensus.cc:348] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.747568 1681 raft_consensus.cc:374] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.747635 1681 raft_consensus.cc:729] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.747810 1681 consensus_queue.cc:260] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.748282 1489 raft_consensus.cc:2454] T e2f2a248c4924e539a7faea914ed64b7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.748621 1681 ts_tablet_manager.cc:1398] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 20:12:13.748658 1604 leader_election.cc:302] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.748880 1681 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.749260 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2f2a248c4924e539a7faea914ed64b7" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.749411 1564 raft_consensus.cc:3037] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.750607 1681 tablet_bootstrap.cc:654] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.753283 1564 raft_consensus.cc:2454] T e2f2a248c4924e539a7faea914ed64b7 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.748888 1803 raft_consensus.cc:2781] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.754617 1803 raft_consensus.cc:686] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.754729 1831 raft_consensus.cc:482] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.754876 1831 raft_consensus.cc:504] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.754853 1803 consensus_queue.cc:237] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.755421 1831 leader_election.cc:288] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.755761 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b9253ebcd94335aee17a5b039e712a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:13.756140 1457 leader_election.cc:341] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.757840 1389 catalog_manager.cc:5484] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.758356 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b9253ebcd94335aee17a5b039e712a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.758430 1688 tablet_bootstrap.cc:492] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.758500 1641 raft_consensus.cc:2454] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.758534 1688 ts_tablet_manager.cc:1367] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.006s
I20240501 20:12:13.758750 1681 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.758860 1681 ts_tablet_manager.cc:1367] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20240501 20:12:13.759207 1688 raft_consensus.cc:348] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.759369 1688 raft_consensus.cc:374] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.759433 1688 raft_consensus.cc:729] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.759486 1681 raft_consensus.cc:348] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.759629 1681 raft_consensus.cc:374] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.759704 1681 raft_consensus.cc:729] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.759629 1688 consensus_queue.cc:260] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.759866 1681 consensus_queue.cc:260] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.760413 1681 ts_tablet_manager.cc:1398] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 20:12:13.760617 1457 leader_election.cc:302] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.760978 1752 raft_consensus.cc:2781] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.761086 1752 raft_consensus.cc:482] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.761204 1752 raft_consensus.cc:3037] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.762972 1688 ts_tablet_manager.cc:1398] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 20:12:13.763499 1752 raft_consensus.cc:504] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.764245 1688 tablet_bootstrap.cc:492] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.765646 1688 tablet_bootstrap.cc:654] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.766347 1565 raft_consensus.cc:3037] T 599e699186cd4a8ebf71634a746d7f1a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.767688 1752 leader_election.cc:288] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.760640 1681 tablet_bootstrap.cc:492] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.768216 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b9253ebcd94335aee17a5b039e712a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.768352 1641 raft_consensus.cc:3037] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.769790 1681 tablet_bootstrap.cc:654] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.770530 1564 raft_consensus.cc:3037] T d5a1b45e9be5446cb5ad18906381d9fd P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.770767 1641 raft_consensus.cc:2454] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.771320 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b9253ebcd94335aee17a5b039e712a" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.772130 1457 leader_election.cc:341] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.772676 1457 leader_election.cc:302] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.773077 1752 raft_consensus.cc:2781] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.773178 1752 raft_consensus.cc:686] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.773394 1752 consensus_queue.cc:237] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.774365 1799 raft_consensus.cc:482] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.774482 1799 raft_consensus.cc:504] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.775012 1799 leader_election.cc:288] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.775487 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "880cb9bb122a4337bb96b871a9cef339" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.775645 1488 raft_consensus.cc:2454] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.775508 1831 consensus_queue.cc:1035] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.776190 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "880cb9bb122a4337bb96b871a9cef339" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.776342 1604 leader_election.cc:302] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.776587 1696 raft_consensus.cc:2781] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.776651 1696 raft_consensus.cc:482] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.776705 1696 raft_consensus.cc:3037] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
W20240501 20:12:13.777305 1606 leader_election.cc:341] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.779280 1696 raft_consensus.cc:504] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.779807 1696 leader_election.cc:288] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.782135 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "880cb9bb122a4337bb96b871a9cef339" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.782632 1606 leader_election.cc:341] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.782485 1389 catalog_manager.cc:5484] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.782850 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "880cb9bb122a4337bb96b871a9cef339" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.782995 1489 raft_consensus.cc:3037] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.786984 1489 raft_consensus.cc:2454] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.787331 1604 leader_election.cc:302] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.787703 1696 raft_consensus.cc:2781] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.787873 1696 raft_consensus.cc:686] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.788120 1696 consensus_queue.cc:237] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.791603 1681 tablet_bootstrap.cc:492] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.791719 1681 ts_tablet_manager.cc:1367] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.003s
I20240501 20:12:13.792412 1681 raft_consensus.cc:348] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.792119 1389 catalog_manager.cc:5484] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.792569 1681 raft_consensus.cc:374] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.792624 1681 raft_consensus.cc:729] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.792791 1681 consensus_queue.cc:260] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.793305 1681 ts_tablet_manager.cc:1398] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:13.793541 1681 tablet_bootstrap.cc:492] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Bootstrap starting.
I20240501 20:12:13.793787 1688 tablet_bootstrap.cc:492] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.793907 1688 ts_tablet_manager.cc:1367] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.019s
I20240501 20:12:13.794520 1688 raft_consensus.cc:348] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.794695 1688 raft_consensus.cc:374] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.794752 1688 raft_consensus.cc:729] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.795042 1681 tablet_bootstrap.cc:654] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.794968 1688 consensus_queue.cc:260] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.795516 1688 ts_tablet_manager.cc:1398] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 20:12:13.795764 1688 tablet_bootstrap.cc:492] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.796773 1696 raft_consensus.cc:482] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.796893 1696 raft_consensus.cc:504] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.797312 1688 tablet_bootstrap.cc:654] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.797447 1696 leader_election.cc:288] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.797941 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4126cea4e4a04d81a41f81c42d218866" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.798120 1489 raft_consensus.cc:2454] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.798471 1604 leader_election.cc:302] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.798709 1696 raft_consensus.cc:2781] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.798769 1696 raft_consensus.cc:482] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.798828 1696 raft_consensus.cc:3037] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.801498 1696 raft_consensus.cc:504] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.802351 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4126cea4e4a04d81a41f81c42d218866" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.802515 1489 raft_consensus.cc:3037] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.803553 1564 raft_consensus.cc:3037] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.805159 1756 raft_consensus.cc:482] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.805342 1696 leader_election.cc:288] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.805322 1756 raft_consensus.cc:504] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.806042 1756 leader_election.cc:288] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.807065 1563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4126cea4e4a04d81a41f81c42d218866" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.807857 1831 consensus_queue.cc:1035] T d5a1b45e9be5446cb5ad18906381d9fd P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.808157 1566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4126cea4e4a04d81a41f81c42d218866" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
W20240501 20:12:13.808530 1606 leader_election.cc:341] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.808708 1488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c51e1cc64e4cc9bd2dc97403a28759" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.808879 1488 raft_consensus.cc:2454] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:13.805187 1489 raft_consensus.cc:2454] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.809600 1640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c51e1cc64e4cc9bd2dc97403a28759" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.809772 1640 raft_consensus.cc:2454] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:13.810101 1530 leader_election.cc:302] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.810268 1604 leader_election.cc:302] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.810447 1756 raft_consensus.cc:2781] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.810514 1756 raft_consensus.cc:482] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.810570 1756 raft_consensus.cc:3037] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.810715 1800 raft_consensus.cc:2781] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.810817 1800 raft_consensus.cc:686] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.810683 1390 catalog_manager.cc:5484] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.811038 1800 consensus_queue.cc:237] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
W20240501 20:12:13.812803 1606 leader_election.cc:341] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.813023 1756 raft_consensus.cc:504] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.813177 1696 consensus_queue.cc:1035] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.813910 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c51e1cc64e4cc9bd2dc97403a28759" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.814080 1492 raft_consensus.cc:3037] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.815923 1492 raft_consensus.cc:2454] T c3c51e1cc64e4cc9bd2dc97403a28759 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:13.816268 1530 leader_election.cc:302] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.816494 1700 raft_consensus.cc:2781] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.816592 1700 raft_consensus.cc:686] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:13.816776 1700 consensus_queue.cc:237] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.819195 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c51e1cc64e4cc9bd2dc97403a28759" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.819350 1641 raft_consensus.cc:3037] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.819586 1681 tablet_bootstrap.cc:492] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: No bootstrap required, opened a new log
I20240501 20:12:13.819712 1681 ts_tablet_manager.cc:1367] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.000s
I20240501 20:12:13.820509 1681 raft_consensus.cc:348] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.820675 1681 raft_consensus.cc:374] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.820717 1681 raft_consensus.cc:729] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.820871 1681 consensus_queue.cc:260] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.822014 1641 raft_consensus.cc:2454] T c3c51e1cc64e4cc9bd2dc97403a28759 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:13.822666 1756 leader_election.cc:288] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.824558 1831 raft_consensus.cc:482] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.824683 1831 raft_consensus.cc:504] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.825237 1831 leader_election.cc:288] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.824534 1681 ts_tablet_manager.cc:1398] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 20:12:13.825743 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.826203 1641 raft_consensus.cc:2454] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.825743 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.826508 1457 leader_election.cc:302] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.826736 1831 raft_consensus.cc:2781] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.826823 1831 raft_consensus.cc:482] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.826884 1831 raft_consensus.cc:3037] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.828881 1704 consensus_queue.cc:1035] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 20:12:13.826753 1457 leader_election.cc:341] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.830044 1831 raft_consensus.cc:504] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.832306 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
W20240501 20:12:13.832768 1457 leader_election.cc:341] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): Illegal state: must be running to vote when last-logged opid is not known
I20240501 20:12:13.832743 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.832881 1831 leader_election.cc:288] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.832938 1641 raft_consensus.cc:3037] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.835541 1641 raft_consensus.cc:2454] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.835907 1457 leader_election.cc:302] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters: ea4dd09ef4f040618fc481ba902e8726
I20240501 20:12:13.836264 1831 raft_consensus.cc:2781] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.836380 1831 raft_consensus.cc:686] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.836601 1831 consensus_queue.cc:237] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.837232 1390 catalog_manager.cc:5484] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.838881 1688 tablet_bootstrap.cc:492] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.839854 1688 ts_tablet_manager.cc:1367] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.044s user 0.014s sys 0.021s
I20240501 20:12:13.840564 1688 raft_consensus.cc:348] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.840742 1688 raft_consensus.cc:374] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.840798 1688 raft_consensus.cc:729] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.840981 1688 consensus_queue.cc:260] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.841503 1688 ts_tablet_manager.cc:1398] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:13.841373 1387 catalog_manager.cc:5484] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.841826 1688 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.843103 1390 catalog_manager.cc:5484] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:13.843344 1688 tablet_bootstrap.cc:654] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.845301 1704 consensus_queue.cc:1035] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.850507 1688 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.850625 1688 ts_tablet_manager.cc:1367] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20240501 20:12:13.851318 1688 raft_consensus.cc:348] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.851485 1688 raft_consensus.cc:374] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.851536 1688 raft_consensus.cc:729] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.851624 1799 consensus_queue.cc:1035] T 17b0ff3e282b40c9b3feb276bf62f02f P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.851692 1688 consensus_queue.cc:260] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.852195 1688 ts_tablet_manager.cc:1398] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:13.852461 1688 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.853962 1688 tablet_bootstrap.cc:654] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.855734 1688 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.855861 1688 ts_tablet_manager.cc:1367] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.856526 1688 raft_consensus.cc:348] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.856714 1688 raft_consensus.cc:374] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.856773 1688 raft_consensus.cc:729] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.856958 1688 consensus_queue.cc:260] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.857457 1688 ts_tablet_manager.cc:1398] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 20:12:13.857692 1688 tablet_bootstrap.cc:492] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.857661 1799 consensus_queue.cc:1035] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.859356 1688 tablet_bootstrap.cc:654] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.863571 1803 consensus_queue.cc:1035] T 0b62689a9a324b1293e98ef3d09f2419 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.863674 1688 tablet_bootstrap.cc:492] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.863777 1688 ts_tablet_manager.cc:1367] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20240501 20:12:13.864404 1688 raft_consensus.cc:348] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.864585 1688 raft_consensus.cc:374] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.864634 1688 raft_consensus.cc:729] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.864804 1688 consensus_queue.cc:260] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.865312 1688 ts_tablet_manager.cc:1398] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 20:12:13.865656 1688 tablet_bootstrap.cc:492] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.866869 1688 tablet_bootstrap.cc:654] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.868554 1688 tablet_bootstrap.cc:492] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.868675 1688 ts_tablet_manager.cc:1367] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.869738 1688 raft_consensus.cc:348] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.869918 1688 raft_consensus.cc:374] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.869976 1688 raft_consensus.cc:729] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.870136 1688 consensus_queue.cc:260] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.870596 1688 ts_tablet_manager.cc:1398] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 20:12:13.870813 1688 tablet_bootstrap.cc:492] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.871831 1688 tablet_bootstrap.cc:654] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.873229 1688 tablet_bootstrap.cc:492] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.873317 1688 ts_tablet_manager.cc:1367] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 20:12:13.873728 1688 raft_consensus.cc:348] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.873843 1688 raft_consensus.cc:374] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.873872 1688 raft_consensus.cc:729] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.874004 1688 consensus_queue.cc:260] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.874401 1688 ts_tablet_manager.cc:1398] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:13.874605 1688 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.875576 1688 tablet_bootstrap.cc:654] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.875890 1800 raft_consensus.cc:482] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.876024 1800 raft_consensus.cc:504] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.876598 1800 leader_election.cc:288] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.876839 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb7d6d5f5824535bd64f429ef8f0693" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.877007 1492 raft_consensus.cc:2454] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.877238 1688 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.877310 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb7d6d5f5824535bd64f429ef8f0693" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.877391 1688 ts_tablet_manager.cc:1367] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:13.877460 1604 leader_election.cc:302] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.877485 1565 raft_consensus.cc:2454] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 0.
I20240501 20:12:13.878038 1800 raft_consensus.cc:2781] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.878037 1688 raft_consensus.cc:348] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.878183 1800 raft_consensus.cc:482] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.878298 1688 raft_consensus.cc:374] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.878306 1800 raft_consensus.cc:3037] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.878389 1688 raft_consensus.cc:729] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.878651 1688 consensus_queue.cc:260] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.879218 1688 ts_tablet_manager.cc:1398] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:13.879487 1688 tablet_bootstrap.cc:492] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.880841 1688 tablet_bootstrap.cc:654] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.880941 1800 raft_consensus.cc:504] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.881098 1700 raft_consensus.cc:482] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.881250 1700 raft_consensus.cc:504] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.881878 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb7d6d5f5824535bd64f429ef8f0693" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:13.882063 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "880cb9bb122a4337bb96b871a9cef339" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:13.882185 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "880cb9bb122a4337bb96b871a9cef339" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.882306 1489 raft_consensus.cc:2379] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:13.882081 1492 raft_consensus.cc:3037] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.882689 1532 leader_election.cc:302] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:13.882943 1756 raft_consensus.cc:3037] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.883821 1700 leader_election.cc:288] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.884763 1800 leader_election.cc:288] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:13.885149 1492 raft_consensus.cc:2454] T 9fb7d6d5f5824535bd64f429ef8f0693 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.885291 1756 raft_consensus.cc:2726] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:13.886207 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fb7d6d5f5824535bd64f429ef8f0693" candidate_uuid: "e3b9f2e003064a248d8822d0ea062b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.886394 1565 raft_consensus.cc:3037] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.886561 1688 tablet_bootstrap.cc:492] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.886715 1688 ts_tablet_manager.cc:1367] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.007s
I20240501 20:12:13.887862 1688 raft_consensus.cc:348] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.888062 1688 raft_consensus.cc:374] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.888146 1688 raft_consensus.cc:729] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.888331 1688 consensus_queue.cc:260] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.888790 1688 ts_tablet_manager.cc:1398] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 20:12:13.888864 1565 raft_consensus.cc:2454] T 9fb7d6d5f5824535bd64f429ef8f0693 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b9f2e003064a248d8822d0ea062b6b in term 1.
I20240501 20:12:13.889082 1688 tablet_bootstrap.cc:492] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726: Bootstrap starting.
I20240501 20:12:13.889302 1604 leader_election.cc:302] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:13.889546 1800 raft_consensus.cc:2781] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.889813 1800 raft_consensus.cc:686] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Becoming Leader. State: Replica: e3b9f2e003064a248d8822d0ea062b6b, State: Running, Role: LEADER
I20240501 20:12:13.890110 1800 consensus_queue.cc:237] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.890588 1688 tablet_bootstrap.cc:654] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726: Neither blocks nor log segments found. Creating new log.
I20240501 20:12:13.894603 1688 tablet_bootstrap.cc:492] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726: No bootstrap required, opened a new log
I20240501 20:12:13.894748 1688 ts_tablet_manager.cc:1367] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20240501 20:12:13.895252 1688 raft_consensus.cc:348] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.895169 1389 catalog_manager.cc:5484] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3). New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } }
I20240501 20:12:13.895414 1688 raft_consensus.cc:374] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:12:13.895484 1688 raft_consensus.cc:729] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Initialized, Role: FOLLOWER
I20240501 20:12:13.895733 1688 consensus_queue.cc:260] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.896240 1688 ts_tablet_manager.cc:1398] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 20:12:13.906328 1756 consensus_queue.cc:1035] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.909696 1756 consensus_queue.cc:1035] T 34308521f7b7481fafef0344fec556f2 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.912904 1831 consensus_queue.cc:1035] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.916435 1752 consensus_queue.cc:1035] T c95b72ede9fc487b87490e2d4a75e261 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:13.979089 1752 raft_consensus.cc:482] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:13.979250 1752 raft_consensus.cc:504] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.979761 1752 leader_election.cc:288] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.980118 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9178c194e31432eb382d89615c2c7d7" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:13.980149 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9178c194e31432eb382d89615c2c7d7" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:13.980289 1565 raft_consensus.cc:2454] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.980320 1641 raft_consensus.cc:2454] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:13.980618 1457 leader_election.cc:302] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.980798 1752 raft_consensus.cc:2781] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:13.980862 1752 raft_consensus.cc:482] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:13.980903 1752 raft_consensus.cc:3037] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.982559 1752 raft_consensus.cc:504] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.982996 1752 leader_election.cc:288] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:13.983287 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9178c194e31432eb382d89615c2c7d7" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:13.983331 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9178c194e31432eb382d89615c2c7d7" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:13.983433 1565 raft_consensus.cc:3037] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.983455 1641 raft_consensus.cc:3037] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:13.985131 1641 raft_consensus.cc:2454] T d9178c194e31432eb382d89615c2c7d7 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.985128 1565 raft_consensus.cc:2454] T d9178c194e31432eb382d89615c2c7d7 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:13.985457 1457 leader_election.cc:302] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:13.985642 1752 raft_consensus.cc:2781] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:13.985738 1752 raft_consensus.cc:686] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:13.985946 1752 consensus_queue.cc:237] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:13.988683 1389 catalog_manager.cc:5484] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:14.007414 1565 raft_consensus.cc:3037] T 43925e23a6cc4c3e9fbb3b33cf39d72a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.009732 1800 consensus_queue.cc:1035] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.013027 1803 consensus_queue.cc:1035] T 43925e23a6cc4c3e9fbb3b33cf39d72a P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.030445 1800 consensus_queue.cc:1035] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.033849 1704 consensus_queue.cc:1035] T 19a3e65d25d74d469efe3fdd86b6e360 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.041167 1752 consensus_queue.cc:1035] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.043617 1565 raft_consensus.cc:3037] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.046651 1752 consensus_queue.cc:1035] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.050529 1756 raft_consensus.cc:482] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:14.050648 1756 raft_consensus.cc:504] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.051265 1756 leader_election.cc:288] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.051486 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4126cea4e4a04d81a41f81c42d218866" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:14.051663 1492 raft_consensus.cc:2379] T 4126cea4e4a04d81a41f81c42d218866 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:14.052206 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4126cea4e4a04d81a41f81c42d218866" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:14.052588 1532 leader_election.cc:302] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:14.052779 1756 raft_consensus.cc:3037] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.054500 1756 raft_consensus.cc:2726] T 4126cea4e4a04d81a41f81c42d218866 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:14.056839 1756 raft_consensus.cc:482] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:14.056952 1756 raft_consensus.cc:504] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.057463 1756 leader_election.cc:288] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.057742 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41682f6de504ad78a616818b19493bc" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:14.057832 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41682f6de504ad78a616818b19493bc" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:14.057905 1492 raft_consensus.cc:2379] T c41682f6de504ad78a616818b19493bc P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate e3b9f2e003064a248d8822d0ea062b6b in this term.
I20240501 20:12:14.059937 1530 leader_election.cc:302] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:14.060142 1756 raft_consensus.cc:3037] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.062139 1756 raft_consensus.cc:2726] T c41682f6de504ad78a616818b19493bc P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:14.066748 1799 consensus_queue.cc:1035] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.068854 1699 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.072031 1565 raft_consensus.cc:3037] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.072706 1800 consensus_queue.cc:1035] T c41682f6de504ad78a616818b19493bc P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.076818 1752 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.078452 1564 raft_consensus.cc:3037] T fd28f411966a432aa3a8cca7076c3ca7 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.081243 1704 consensus_queue.cc:1035] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.084949 1799 consensus_queue.cc:1035] T fd28f411966a432aa3a8cca7076c3ca7 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.085529 1698 raft_consensus.cc:482] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:14.085657 1698 raft_consensus.cc:504] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.086230 1698 leader_election.cc:288] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.086843 1492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b9253ebcd94335aee17a5b039e712a" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:14.087543 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b9253ebcd94335aee17a5b039e712a" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:14.087711 1641 raft_consensus.cc:2379] T 38b9253ebcd94335aee17a5b039e712a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in this term.
I20240501 20:12:14.088025 1532 leader_election.cc:302] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:14.088332 1756 raft_consensus.cc:3037] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.090795 1756 raft_consensus.cc:2726] T 38b9253ebcd94335aee17a5b039e712a P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:14.127036 1752 consensus_queue.cc:1035] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.130599 1699 consensus_queue.cc:1035] T c98df9e665f744c88e3edd852ee06f96 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.136627 1831 raft_consensus.cc:482] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:14.136752 1831 raft_consensus.cc:504] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.137286 1831 leader_election.cc:288] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.137629 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e32716adda49f9b25a5cad3ed195b9" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:14.137841 1641 raft_consensus.cc:2454] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:14.138105 1565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e32716adda49f9b25a5cad3ed195b9" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726" is_pre_election: true
I20240501 20:12:14.138166 1457 leader_election.cc:302] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b; no voters:
I20240501 20:12:14.138269 1565 raft_consensus.cc:2454] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 0.
I20240501 20:12:14.138362 1831 raft_consensus.cc:2781] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:14.138435 1831 raft_consensus.cc:482] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:14.138494 1831 raft_consensus.cc:3037] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.139899 1745 consensus_queue.cc:1035] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.140409 1831 raft_consensus.cc:504] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.140862 1831 leader_election.cc:288] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Requested vote from peers ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.141211 1564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e32716adda49f9b25a5cad3ed195b9" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4dd09ef4f040618fc481ba902e8726"
I20240501 20:12:14.141250 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e32716adda49f9b25a5cad3ed195b9" candidate_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:14.141381 1564 raft_consensus.cc:3037] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.141381 1641 raft_consensus.cc:3037] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.143920 1641 raft_consensus.cc:2454] T 29e32716adda49f9b25a5cad3ed195b9 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:14.143920 1564 raft_consensus.cc:2454] T 29e32716adda49f9b25a5cad3ed195b9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in term 1.
I20240501 20:12:14.144264 1457 leader_election.cc:302] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:14.144685 1831 raft_consensus.cc:2781] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:14.144812 1831 raft_consensus.cc:686] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Becoming Leader. State: Replica: d7a3dc5590604ae1ba6e4b2a81ad1ae6, State: Running, Role: LEADER
I20240501 20:12:14.144774 1803 consensus_queue.cc:1035] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.145035 1831 consensus_queue.cc:237] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.148761 1752 consensus_queue.cc:1035] T fe821f07300b4cc4a3e616b989b8592f P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.153435 1390 catalog_manager.cc:5484] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1). New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:14.159456 1696 consensus_queue.cc:1035] T e2f2a248c4924e539a7faea914ed64b7 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.185464 1704 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 20:12:14.185926 1438 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 20:12:14.189401 1803 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.196255 1756 raft_consensus.cc:482] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:14.196383 1756 raft_consensus.cc:504] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.196836 1756 leader_election.cc:288] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.197167 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873087761cda482f8756584663220652" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:14.197206 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873087761cda482f8756584663220652" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:14.197309 1489 raft_consensus.cc:2454] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:14.197383 1641 raft_consensus.cc:2454] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 0.
I20240501 20:12:14.197597 1530 leader_election.cc:302] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:14.197778 1756 raft_consensus.cc:2781] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 20:12:14.197855 1756 raft_consensus.cc:482] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 20:12:14.197925 1756 raft_consensus.cc:3037] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.199756 1756 raft_consensus.cc:504] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.200181 1756 leader_election.cc:288] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Requested vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.200487 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873087761cda482f8756584663220652" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6"
I20240501 20:12:14.200487 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873087761cda482f8756584663220652" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b"
I20240501 20:12:14.200688 1489 raft_consensus.cc:3037] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.200675 1641 raft_consensus.cc:3037] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.203379 1489 raft_consensus.cc:2454] T 873087761cda482f8756584663220652 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:14.203379 1641 raft_consensus.cc:2454] T 873087761cda482f8756584663220652 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4dd09ef4f040618fc481ba902e8726 in term 1.
I20240501 20:12:14.203725 1530 leader_election.cc:302] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, ea4dd09ef4f040618fc481ba902e8726; no voters:
I20240501 20:12:14.203935 1756 raft_consensus.cc:2781] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:12:14.204051 1756 raft_consensus.cc:686] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Becoming Leader. State: Replica: ea4dd09ef4f040618fc481ba902e8726, State: Running, Role: LEADER
I20240501 20:12:14.204274 1756 consensus_queue.cc:237] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.206894 1387 catalog_manager.cc:5484] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2). New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:14.253756 1831 consensus_queue.cc:1035] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.256598 1756 raft_consensus.cc:482] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 20:12:14.256748 1756 raft_consensus.cc:504] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } }
I20240501 20:12:14.257339 1756 leader_election.cc:288] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831), e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:14.257788 1831 consensus_queue.cc:1035] T 38b9253ebcd94335aee17a5b039e712a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.257897 1641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b9f2e003064a248d8822d0ea062b6b" is_pre_election: true
I20240501 20:12:14.258436 1641 raft_consensus.cc:2379] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea4dd09ef4f040618fc481ba902e8726 in current term 1: Already voted for candidate d7a3dc5590604ae1ba6e4b2a81ad1ae6 in this term.
I20240501 20:12:14.257608 1489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a46c25fb679479183f9803a9ad3c0c0" candidate_uuid: "ea4dd09ef4f040618fc481ba902e8726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" is_pre_election: true
I20240501 20:12:14.260134 1532 leader_election.cc:302] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea4dd09ef4f040618fc481ba902e8726; no voters: d7a3dc5590604ae1ba6e4b2a81ad1ae6, e3b9f2e003064a248d8822d0ea062b6b
I20240501 20:12:14.260471 1756 raft_consensus.cc:3037] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:12:14.262423 1756 raft_consensus.cc:2726] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 20:12:14.319792 1831 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.323120 1831 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.332772 1698 consensus_queue.cc:1035] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.334939 1704 consensus_queue.cc:1035] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.336691 1698 consensus_queue.cc:1035] T c3c51e1cc64e4cc9bd2dc97403a28759 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.340819 1800 consensus_queue.cc:1035] T 9fb7d6d5f5824535bd64f429ef8f0693 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.343667 1696 consensus_queue.cc:1035] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.348434 1799 consensus_queue.cc:1035] T 4126cea4e4a04d81a41f81c42d218866 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.584647 1831 consensus_queue.cc:1035] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.588105 1831 consensus_queue.cc:1035] T d9178c194e31432eb382d89615c2c7d7 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.662508 1699 consensus_queue.cc:1035] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.665910 1699 consensus_queue.cc:1035] T 29e32716adda49f9b25a5cad3ed195b9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.689538 1698 consensus_queue.cc:1035] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.693122 1698 consensus_queue.cc:1035] T 873087761cda482f8756584663220652 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 20:12:14.705629 400 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:12:14.709272 2069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:14.734678 2070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:12:14.735643 2072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:12:14.736388 400 server_base.cc:1034] running on GCE node
I20240501 20:12:14.736697 400 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:12:14.736752 400 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:12:14.736779 400 hybrid_clock.cc:648] HybridClock initialized: now 1714594334736775 us; error 0 us; skew 500 ppm
I20240501 20:12:14.736927 400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:12:14.738157 400 webserver.cc:460] Webserver started at http://127.0.100.4:39677/ using document root <none> and password file <none>
I20240501 20:12:14.738356 400 fs_manager.cc:359] Metadata directory not provided
I20240501 20:12:14.738423 400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:12:14.738548 400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:12:14.739138 400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-3-root/instance:
uuid: "d79f04148ddc45aea5b7eef7087a6631"
format_stamp: "Formatted at 2024-05-01 20:12:14 on dist-test-slave-hhxv"
I20240501 20:12:14.741770 400 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 20:12:14.743311 2077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:14.743603 400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 20:12:14.743697 400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-3-root
uuid: "d79f04148ddc45aea5b7eef7087a6631"
format_stamp: "Formatted at 2024-05-01 20:12:14 on dist-test-slave-hhxv"
I20240501 20:12:14.743793 400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:12:14.760288 400 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:12:14.760695 400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:12:14.761169 400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:12:14.761893 400 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:12:14.761946 400 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:14.762019 400 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:12:14.762059 400 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:12:14.775847 400 rpc_server.cc:307] RPC server started. Bound to: 127.0.100.4:39911
I20240501 20:12:14.775866 2139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.100.4:39911 every 8 connection(s)
I20240501 20:12:14.777199 400 auto_leader_rebalancer-test.cc:405] add a tserver: d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:14.782353 2140 heartbeater.cc:347] Connected to a master server at 127.0.100.62:37747
I20240501 20:12:14.782449 2140 heartbeater.cc:464] Registering TS with master...
I20240501 20:12:14.782725 2140 heartbeater.cc:511] Master 127.0.100.62:37747 requested a full tablet report, sending...
I20240501 20:12:14.783388 1387 ts_manager.cc:194] Registered new tserver with Master: d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911)
I20240501 20:12:14.784226 1387 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46882
I20240501 20:12:15.206117 1641 consensus_queue.cc:237] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.208240 1488 raft_consensus.cc:1261] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.208328 1565 raft_consensus.cc:1261] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.208783 1799 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:15.209779 1799 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:15.213075 1800 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.213560 1488 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
W20240501 20:12:15.215399 1606 consensus_peers.cc:485] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c88aa6fcedc6495ba20b1e5a5a59a554. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:15.217433 1565 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.219969 1387 catalog_manager.cc:5484] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:15.229511 1565 consensus_queue.cc:237] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.232329 1488 raft_consensus.cc:1261] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.233358 1698 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:15.236927 1641 raft_consensus.cc:1261] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.237782 1700 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:15.238708 1698 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.239526 1641 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
W20240501 20:12:15.241375 1532 consensus_peers.cc:485] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e68951f3197141fabb5828e9e87545a8. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:15.241619 1488 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.247845 1641 consensus_queue.cc:237] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.248968 1389 catalog_manager.cc:5484] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.249976 1488 raft_consensus.cc:1261] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.250181 1565 raft_consensus.cc:1261] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.250599 1800 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 20:12:15.250836 1606 consensus_peers.cc:485] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32b168a9a8104ccbab55dfc28be4a612. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:15.250964 1803 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:15.254055 1800 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.254895 1488 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.257266 1565 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.260268 1387 catalog_manager.cc:5484] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:15.261835 1641 consensus_queue.cc:237] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
W20240501 20:12:15.266156 1606 consensus_peers.cc:485] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f46990a85ef946b0b40127c23e2696e9. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:15.266618 1488 raft_consensus.cc:1261] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.267167 1803 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:15.269097 1800 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.269745 1488 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.271432 1564 raft_consensus.cc:1261] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:15.272385 1803 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:15.275122 1564 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:15.275243 1389 catalog_manager.cc:5484] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:15.720749 2168 ts_tablet_manager.cc:902] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:15.722853 2168 tablet_copy_client.cc:308] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.3:44359
I20240501 20:12:15.729256 1651 tablet_copy_service.cc:140] P e3b9f2e003064a248d8822d0ea062b6b: Received BeginTabletCopySession request for tablet c88aa6fcedc6495ba20b1e5a5a59a554 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:33516)
I20240501 20:12:15.729437 1651 tablet_copy_service.cc:161] P e3b9f2e003064a248d8822d0ea062b6b: Beginning new tablet copy session on tablet c88aa6fcedc6495ba20b1e5a5a59a554 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:33516: session id = d79f04148ddc45aea5b7eef7087a6631-c88aa6fcedc6495ba20b1e5a5a59a554
I20240501 20:12:15.732625 1651 tablet_copy_source_session.cc:205] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:15.734334 2168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c88aa6fcedc6495ba20b1e5a5a59a554. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:15.739765 2168 tablet_copy_client.cc:783] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:15.740015 2168 tablet_copy_client.cc:647] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:15.742116 2168 tablet_copy_client.cc:523] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:15.745747 2168 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:15.751998 2168 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:15.752354 2168 tablet_bootstrap.cc:492] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:15.752605 2168 ts_tablet_manager.cc:1367] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240501 20:12:15.753289 2168 raft_consensus.cc:348] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.753485 2168 raft_consensus.cc:729] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:15.753662 2168 consensus_queue.cc:260] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.754384 2168 ts_tablet_manager.cc:1398] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240501 20:12:15.754422 2140 heartbeater.cc:503] Master 127.0.100.62:37747 was elected leader, sending a full tablet report...
I20240501 20:12:15.755079 1651 tablet_copy_service.cc:342] P e3b9f2e003064a248d8822d0ea062b6b: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-c88aa6fcedc6495ba20b1e5a5a59a554 received from {username='slave'} at 127.0.0.1:33516
I20240501 20:12:15.755211 1651 tablet_copy_service.cc:433] P e3b9f2e003064a248d8822d0ea062b6b: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-c88aa6fcedc6495ba20b1e5a5a59a554 on tablet c88aa6fcedc6495ba20b1e5a5a59a554 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:15.818327 2168 ts_tablet_manager.cc:902] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:15.819808 2181 ts_tablet_manager.cc:902] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:15.828963 2168 tablet_copy_client.cc:308] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.3:44359
I20240501 20:12:15.829252 2181 tablet_copy_client.cc:308] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.3:44359
I20240501 20:12:15.829488 1651 tablet_copy_service.cc:140] P e3b9f2e003064a248d8822d0ea062b6b: Received BeginTabletCopySession request for tablet f46990a85ef946b0b40127c23e2696e9 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:33516)
I20240501 20:12:15.829588 1651 tablet_copy_service.cc:161] P e3b9f2e003064a248d8822d0ea062b6b: Beginning new tablet copy session on tablet f46990a85ef946b0b40127c23e2696e9 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:33516: session id = d79f04148ddc45aea5b7eef7087a6631-f46990a85ef946b0b40127c23e2696e9
I20240501 20:12:15.829782 1650 tablet_copy_service.cc:140] P e3b9f2e003064a248d8822d0ea062b6b: Received BeginTabletCopySession request for tablet 32b168a9a8104ccbab55dfc28be4a612 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:33516)
I20240501 20:12:15.829929 1650 tablet_copy_service.cc:161] P e3b9f2e003064a248d8822d0ea062b6b: Beginning new tablet copy session on tablet 32b168a9a8104ccbab55dfc28be4a612 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:33516: session id = d79f04148ddc45aea5b7eef7087a6631-32b168a9a8104ccbab55dfc28be4a612
I20240501 20:12:15.831517 1651 tablet_copy_source_session.cc:205] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:15.831763 1650 tablet_copy_source_session.cc:205] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:15.832458 2168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f46990a85ef946b0b40127c23e2696e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:15.832676 2181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32b168a9a8104ccbab55dfc28be4a612. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:15.837769 2168 tablet_copy_client.cc:783] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:15.837970 2168 tablet_copy_client.cc:647] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:15.839072 2181 tablet_copy_client.cc:783] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:15.839318 2181 tablet_copy_client.cc:647] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:15.840245 2168 tablet_copy_client.cc:523] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:15.840907 2181 tablet_copy_client.cc:523] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:15.843336 2181 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:15.843418 2168 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:15.856117 2181 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:15.856559 2181 tablet_bootstrap.cc:492] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:15.856838 2181 ts_tablet_manager.cc:1367] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.004s
I20240501 20:12:15.857625 2181 raft_consensus.cc:348] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.857920 2181 raft_consensus.cc:729] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:15.858405 2181 consensus_queue.cc:260] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.859371 2181 ts_tablet_manager.cc:1398] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 20:12:15.859724 2187 ts_tablet_manager.cc:902] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:15.860141 2168 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:15.860178 1650 tablet_copy_service.cc:342] P e3b9f2e003064a248d8822d0ea062b6b: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-32b168a9a8104ccbab55dfc28be4a612 received from {username='slave'} at 127.0.0.1:33516
I20240501 20:12:15.860296 1650 tablet_copy_service.cc:433] P e3b9f2e003064a248d8822d0ea062b6b: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-32b168a9a8104ccbab55dfc28be4a612 on tablet 32b168a9a8104ccbab55dfc28be4a612 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:15.860463 2168 tablet_bootstrap.cc:492] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:15.860647 2168 ts_tablet_manager.cc:1367] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.010s
I20240501 20:12:15.861447 2168 raft_consensus.cc:348] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.861667 2168 raft_consensus.cc:729] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:15.861838 2168 consensus_queue.cc:260] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.862588 2168 ts_tablet_manager.cc:1398] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 20:12:15.863468 1650 tablet_copy_service.cc:342] P e3b9f2e003064a248d8822d0ea062b6b: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-f46990a85ef946b0b40127c23e2696e9 received from {username='slave'} at 127.0.0.1:33516
I20240501 20:12:15.863559 1650 tablet_copy_service.cc:433] P e3b9f2e003064a248d8822d0ea062b6b: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-f46990a85ef946b0b40127c23e2696e9 on tablet f46990a85ef946b0b40127c23e2696e9 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:15.865820 2187 tablet_copy_client.cc:308] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.2:35033
I20240501 20:12:15.871202 1577 tablet_copy_service.cc:140] P ea4dd09ef4f040618fc481ba902e8726: Received BeginTabletCopySession request for tablet e68951f3197141fabb5828e9e87545a8 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:55436)
I20240501 20:12:15.871330 1577 tablet_copy_service.cc:161] P ea4dd09ef4f040618fc481ba902e8726: Beginning new tablet copy session on tablet e68951f3197141fabb5828e9e87545a8 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:55436: session id = d79f04148ddc45aea5b7eef7087a6631-e68951f3197141fabb5828e9e87545a8
I20240501 20:12:15.873745 1577 tablet_copy_source_session.cc:205] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:15.874732 2187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68951f3197141fabb5828e9e87545a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:15.879384 2187 tablet_copy_client.cc:783] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:15.879623 2187 tablet_copy_client.cc:647] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:15.880904 2187 tablet_copy_client.cc:523] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:15.883276 2187 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:15.888630 2187 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:15.889019 2187 tablet_bootstrap.cc:492] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:15.889256 2187 ts_tablet_manager.cc:1367] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.001s
I20240501 20:12:15.889796 2187 raft_consensus.cc:348] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.890038 2187 raft_consensus.cc:729] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:15.890213 2187 consensus_queue.cc:260] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:15.890874 2187 ts_tablet_manager.cc:1398] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:15.893465 1577 tablet_copy_service.cc:342] P ea4dd09ef4f040618fc481ba902e8726: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-e68951f3197141fabb5828e9e87545a8 received from {username='slave'} at 127.0.0.1:55436
I20240501 20:12:15.893564 1577 tablet_copy_service.cc:433] P ea4dd09ef4f040618fc481ba902e8726: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-e68951f3197141fabb5828e9e87545a8 on tablet e68951f3197141fabb5828e9e87545a8 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:16.262255 2115 raft_consensus.cc:1203] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:16.274156 2115 raft_consensus.cc:1203] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:16.312515 2115 raft_consensus.cc:1203] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:16.350853 2115 raft_consensus.cc:1203] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:16.735314 1803 raft_consensus.cc:1050] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:16.736313 1803 consensus_queue.cc:237] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.738401 1492 raft_consensus.cc:1261] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.738646 2115 raft_consensus.cc:1261] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.738883 1564 raft_consensus.cc:1261] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.738951 2166 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.740379 2166 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.741125 2166 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.746968 2177 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.747599 2115 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.751999 1564 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.757361 1390 catalog_manager.cc:5484] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.757210 1492 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.763127 1803 raft_consensus.cc:1050] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:16.763664 2166 raft_consensus.cc:1050] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:16.763758 1803 consensus_queue.cc:237] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.764505 2166 consensus_queue.cc:237] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.766245 1492 raft_consensus.cc:1261] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.766418 2114 raft_consensus.cc:1261] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.766507 1565 raft_consensus.cc:1261] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.766863 2200 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.767390 2200 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.769239 2200 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.782095 2200 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.788570 1489 raft_consensus.cc:1261] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.788556 1488 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.789191 1803 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.789273 1565 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.792207 2114 raft_consensus.cc:1261] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.793493 1563 raft_consensus.cc:1261] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.794476 2200 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.795056 2177 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.794986 1387 catalog_manager.cc:5484] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.794368 2114 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.797894 2200 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.801975 1641 consensus_queue.cc:237] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.804021 2114 raft_consensus.cc:1261] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.804011 2115 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.805009 2166 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.806785 1566 raft_consensus.cc:1261] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.807006 1564 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.807451 2177 consensus_queue.cc:1035] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.809396 1492 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.809630 2200 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.812856 1641 consensus_queue.cc:237] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.813380 1566 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.815302 2113 raft_consensus.cc:1261] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.815769 1387 catalog_manager.cc:5484] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.816435 2177 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.818585 1492 raft_consensus.cc:1261] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.818965 2114 raft_consensus.cc:2932] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.819386 1803 consensus_queue.cc:1035] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.820045 1803 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.820518 2113 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.821660 2198 raft_consensus.cc:1050] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:16.822325 2198 consensus_queue.cc:237] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.824469 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 32b168a9a8104ccbab55dfc28be4a612 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:16.824720 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet c88aa6fcedc6495ba20b1e5a5a59a554 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:16.824960 1492 raft_consensus.cc:2932] T 32b168a9a8104ccbab55dfc28be4a612 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.825812 2115 raft_consensus.cc:1261] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.826267 1641 raft_consensus.cc:1261] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.826218 1700 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.827023 1700 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.833417 1638 consensus_queue.cc:237] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.834245 1388 catalog_manager.cc:5484] T c88aa6fcedc6495ba20b1e5a5a59a554 P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.834692 1388 catalog_manager.cc:5484] T 32b168a9a8104ccbab55dfc28be4a612 P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.835052 2115 raft_consensus.cc:1261] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.836398 2218 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.839989 1564 raft_consensus.cc:1261] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.840566 2177 consensus_queue.cc:1035] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.841742 2177 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.842003 1475 tablet_service.cc:1514] Processing DeleteTablet for tablet c88aa6fcedc6495ba20b1e5a5a59a554 with delete_type TABLET_DATA_TOMBSTONED (TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42562
I20240501 20:12:16.841974 1566 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.842989 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet 32b168a9a8104ccbab55dfc28be4a612 with delete_type TABLET_DATA_TOMBSTONED (TS ea4dd09ef4f040618fc481ba902e8726 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57588
I20240501 20:12:16.846691 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f46990a85ef946b0b40127c23e2696e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:16.849992 1390 catalog_manager.cc:5484] T f46990a85ef946b0b40127c23e2696e9 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:16.851639 2115 raft_consensus.cc:2932] T f46990a85ef946b0b40127c23e2696e9 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.854305 1481 tablet_service.cc:1514] Processing DeleteTablet for tablet f46990a85ef946b0b40127c23e2696e9 with delete_type TABLET_DATA_TOMBSTONED (TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42562
I20240501 20:12:16.859390 1492 raft_consensus.cc:1261] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:16.859901 1700 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:16.860461 1700 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.864040 2222 tablet_replica.cc:330] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: stopping tablet replica
I20240501 20:12:16.864267 2222 raft_consensus.cc:2229] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:16.864516 2222 raft_consensus.cc:2258] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:16.865245 1641 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.866039 1390 catalog_manager.cc:5484] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:16.870622 2113 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.872769 2222 ts_tablet_manager.cc:1875] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:16.873963 2223 tablet_replica.cc:330] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: stopping tablet replica
I20240501 20:12:16.874480 2223 raft_consensus.cc:2229] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:16.874780 2223 raft_consensus.cc:2258] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:16.876080 2223 ts_tablet_manager.cc:1875] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:16.879712 2222 ts_tablet_manager.cc:1888] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:16.879844 2222 log.cc:1196] T c88aa6fcedc6495ba20b1e5a5a59a554 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root/wals/c88aa6fcedc6495ba20b1e5a5a59a554
I20240501 20:12:16.880643 1374 catalog_manager.cc:4830] TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): tablet c88aa6fcedc6495ba20b1e5a5a59a554 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:16.880875 2222 tablet_replica.cc:330] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: stopping tablet replica
I20240501 20:12:16.881088 2222 raft_consensus.cc:2229] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:16.881312 2222 raft_consensus.cc:2258] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:16.882839 2222 ts_tablet_manager.cc:1875] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:16.884248 2223 ts_tablet_manager.cc:1888] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:16.884347 2223 log.cc:1196] T 32b168a9a8104ccbab55dfc28be4a612 P ea4dd09ef4f040618fc481ba902e8726: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root/wals/32b168a9a8104ccbab55dfc28be4a612
I20240501 20:12:16.885171 1376 catalog_manager.cc:4830] TS ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): tablet 32b168a9a8104ccbab55dfc28be4a612 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:16.886456 1492 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.887490 2222 ts_tablet_manager.cc:1888] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:16.887583 2222 log.cc:1196] T f46990a85ef946b0b40127c23e2696e9 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root/wals/f46990a85ef946b0b40127c23e2696e9
I20240501 20:12:16.888182 1374 catalog_manager.cc:4830] TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): tablet f46990a85ef946b0b40127c23e2696e9 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:16.888523 1564 consensus_queue.cc:237] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:16.890056 2113 raft_consensus.cc:1261] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.890488 2219 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.892107 1489 raft_consensus.cc:1261] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:16.892639 1700 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.895145 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e68951f3197141fabb5828e9e87545a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:16.895459 2113 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.896072 2198 consensus_queue.cc:1035] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:16.897024 1387 catalog_manager.cc:5484] T e68951f3197141fabb5828e9e87545a8 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:16.897148 1489 raft_consensus.cc:2932] T e68951f3197141fabb5828e9e87545a8 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:16.901919 1625 tablet_service.cc:1514] Processing DeleteTablet for tablet e68951f3197141fabb5828e9e87545a8 with delete_type TABLET_DATA_TOMBSTONED (TS e3b9f2e003064a248d8822d0ea062b6b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47074
I20240501 20:12:16.902478 2225 tablet_replica.cc:330] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: stopping tablet replica
I20240501 20:12:16.903928 2225 raft_consensus.cc:2229] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:16.904206 2225 raft_consensus.cc:2258] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:16.904820 2225 ts_tablet_manager.cc:1875] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:16.908596 2225 ts_tablet_manager.cc:1888] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:16.908689 2225 log.cc:1196] T e68951f3197141fabb5828e9e87545a8 P e3b9f2e003064a248d8822d0ea062b6b: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root/wals/e68951f3197141fabb5828e9e87545a8
I20240501 20:12:16.909219 1376 catalog_manager.cc:4830] TS e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): tablet e68951f3197141fabb5828e9e87545a8 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:17.922901 1492 consensus_queue.cc:237] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:17.924883 1566 raft_consensus.cc:1261] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:17.925783 2229 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:17.925951 1638 raft_consensus.cc:1261] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:17.926621 2229 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 20:12:17.930738 1457 consensus_peers.cc:485] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 206e6477b3ef4f9a90696dadebc33275. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:17.933982 1745 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.934506 1638 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.935508 1566 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.939973 1638 consensus_queue.cc:237] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:17.941565 1390 catalog_manager.cc:5484] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.942678 1566 raft_consensus.cc:1261] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:17.942760 1492 raft_consensus.cc:1261] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 20:12:17.942884 1606 consensus_peers.cc:485] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 880cb9bb122a4337bb96b871a9cef339. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:17.943228 2236 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:17.943424 2177 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:17.945962 2218 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.948609 1492 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.948658 1566 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.952149 1638 consensus_queue.cc:237] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:17.954200 1492 raft_consensus.cc:1261] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 20:12:17.954831 1606 consensus_peers.cc:485] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b04ba7f3ce10406fb8c299b54fa3299b. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:17.955694 2236 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:17.956089 1566 raft_consensus.cc:1261] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:17.956584 2218 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:17.956472 1387 catalog_manager.cc:5484] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:17.960608 1566 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.963141 1492 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.960041 2236 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.965490 1388 catalog_manager.cc:5484] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.969358 1492 consensus_queue.cc:237] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
W20240501 20:12:17.971516 1457 consensus_peers.cc:485] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a46c25fb679479183f9803a9ad3c0c0. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:17.971814 1641 raft_consensus.cc:1261] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:17.972301 2229 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:17.972652 1566 raft_consensus.cc:1261] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:17.973280 2229 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:17.974591 2196 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.975939 1566 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.977291 1641 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:17.981505 1390 catalog_manager.cc:5484] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:18.318223 2250 ts_tablet_manager.cc:902] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831)
I20240501 20:12:18.320324 2250 tablet_copy_client.cc:308] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.1:44831
I20240501 20:12:18.326747 1502 tablet_copy_service.cc:140] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Received BeginTabletCopySession request for tablet 206e6477b3ef4f9a90696dadebc33275 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:37784)
I20240501 20:12:18.326889 1502 tablet_copy_service.cc:161] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Beginning new tablet copy session on tablet 206e6477b3ef4f9a90696dadebc33275 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:37784: session id = d79f04148ddc45aea5b7eef7087a6631-206e6477b3ef4f9a90696dadebc33275
I20240501 20:12:18.329173 1502 tablet_copy_source_session.cc:205] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:18.330292 2250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 206e6477b3ef4f9a90696dadebc33275. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:18.335508 2250 tablet_copy_client.cc:783] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:18.335690 2250 tablet_copy_client.cc:647] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:18.337119 2250 tablet_copy_client.cc:523] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:18.339780 2250 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:18.344786 2250 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:18.345330 2250 tablet_bootstrap.cc:492] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:18.345561 2250 ts_tablet_manager.cc:1367] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.006s user 0.007s sys 0.000s
I20240501 20:12:18.346261 2257 ts_tablet_manager.cc:902] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:18.346232 2250 raft_consensus.cc:348] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.346485 2250 raft_consensus.cc:729] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:18.347071 2250 consensus_queue.cc:260] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.348162 2250 ts_tablet_manager.cc:1398] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 20:12:18.349609 1502 tablet_copy_service.cc:342] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-206e6477b3ef4f9a90696dadebc33275 received from {username='slave'} at 127.0.0.1:37784
I20240501 20:12:18.349714 1502 tablet_copy_service.cc:433] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-206e6477b3ef4f9a90696dadebc33275 on tablet 206e6477b3ef4f9a90696dadebc33275 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:18.352144 2257 tablet_copy_client.cc:308] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.3:44359
I20240501 20:12:18.352614 1650 tablet_copy_service.cc:140] P e3b9f2e003064a248d8822d0ea062b6b: Received BeginTabletCopySession request for tablet 880cb9bb122a4337bb96b871a9cef339 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:33516)
I20240501 20:12:18.352741 1650 tablet_copy_service.cc:161] P e3b9f2e003064a248d8822d0ea062b6b: Beginning new tablet copy session on tablet 880cb9bb122a4337bb96b871a9cef339 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:33516: session id = d79f04148ddc45aea5b7eef7087a6631-880cb9bb122a4337bb96b871a9cef339
I20240501 20:12:18.355366 1650 tablet_copy_source_session.cc:205] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:18.356783 2257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 880cb9bb122a4337bb96b871a9cef339. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:18.361478 2257 tablet_copy_client.cc:783] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:18.361660 2257 tablet_copy_client.cc:647] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:18.363117 2257 tablet_copy_client.cc:523] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:18.365682 2257 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:18.371138 2257 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:18.371430 2257 tablet_bootstrap.cc:492] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:18.371799 2257 ts_tablet_manager.cc:1367] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.001s
I20240501 20:12:18.372445 2257 raft_consensus.cc:348] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.372670 2257 raft_consensus.cc:729] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:18.372831 2257 consensus_queue.cc:260] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.373452 2257 ts_tablet_manager.cc:1398] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 20:12:18.373932 1650 tablet_copy_service.cc:342] P e3b9f2e003064a248d8822d0ea062b6b: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-880cb9bb122a4337bb96b871a9cef339 received from {username='slave'} at 127.0.0.1:33516
I20240501 20:12:18.374174 1650 tablet_copy_service.cc:433] P e3b9f2e003064a248d8822d0ea062b6b: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-880cb9bb122a4337bb96b871a9cef339 on tablet 880cb9bb122a4337bb96b871a9cef339 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:18.378504 2257 ts_tablet_manager.cc:902] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:18.380137 2257 tablet_copy_client.cc:308] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.3:44359
I20240501 20:12:18.390532 1650 tablet_copy_service.cc:140] P e3b9f2e003064a248d8822d0ea062b6b: Received BeginTabletCopySession request for tablet b04ba7f3ce10406fb8c299b54fa3299b from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:33516)
I20240501 20:12:18.390652 1650 tablet_copy_service.cc:161] P e3b9f2e003064a248d8822d0ea062b6b: Beginning new tablet copy session on tablet b04ba7f3ce10406fb8c299b54fa3299b from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:33516: session id = d79f04148ddc45aea5b7eef7087a6631-b04ba7f3ce10406fb8c299b54fa3299b
I20240501 20:12:18.392539 1650 tablet_copy_source_session.cc:205] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:18.393433 2257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04ba7f3ce10406fb8c299b54fa3299b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:18.398418 2257 tablet_copy_client.cc:783] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:18.398608 2257 tablet_copy_client.cc:647] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:18.399825 2257 tablet_copy_client.cc:523] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:18.402328 2257 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:18.407971 2257 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:18.408215 2257 tablet_bootstrap.cc:492] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:18.408421 2257 ts_tablet_manager.cc:1367] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.001s
I20240501 20:12:18.409094 2257 raft_consensus.cc:348] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.409268 2257 raft_consensus.cc:729] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:18.409438 2257 consensus_queue.cc:260] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.409942 2257 ts_tablet_manager.cc:1398] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240501 20:12:18.410847 1650 tablet_copy_service.cc:342] P e3b9f2e003064a248d8822d0ea062b6b: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-b04ba7f3ce10406fb8c299b54fa3299b received from {username='slave'} at 127.0.0.1:33516
I20240501 20:12:18.410943 1650 tablet_copy_service.cc:433] P e3b9f2e003064a248d8822d0ea062b6b: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-b04ba7f3ce10406fb8c299b54fa3299b on tablet b04ba7f3ce10406fb8c299b54fa3299b with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:18.582405 2257 ts_tablet_manager.cc:902] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831)
I20240501 20:12:18.597831 2257 tablet_copy_client.cc:308] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.1:44831
I20240501 20:12:18.598390 1502 tablet_copy_service.cc:140] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Received BeginTabletCopySession request for tablet 6a46c25fb679479183f9803a9ad3c0c0 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:37784)
I20240501 20:12:18.598505 1502 tablet_copy_service.cc:161] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Beginning new tablet copy session on tablet 6a46c25fb679479183f9803a9ad3c0c0 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:37784: session id = d79f04148ddc45aea5b7eef7087a6631-6a46c25fb679479183f9803a9ad3c0c0
I20240501 20:12:18.600903 1502 tablet_copy_source_session.cc:205] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:18.601898 2257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a46c25fb679479183f9803a9ad3c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:18.606959 2257 tablet_copy_client.cc:783] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:18.607146 2257 tablet_copy_client.cc:647] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:18.608369 2257 tablet_copy_client.cc:523] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:18.610966 2257 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:18.615821 2257 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:18.616072 2257 tablet_bootstrap.cc:492] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:18.616274 2257 ts_tablet_manager.cc:1367] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240501 20:12:18.616806 2257 raft_consensus.cc:348] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.616971 2257 raft_consensus.cc:729] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:18.617143 2257 consensus_queue.cc:260] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:18.617548 2257 ts_tablet_manager.cc:1398] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240501 20:12:18.618124 1502 tablet_copy_service.cc:342] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-6a46c25fb679479183f9803a9ad3c0c0 received from {username='slave'} at 127.0.0.1:37784
I20240501 20:12:18.618211 1502 tablet_copy_service.cc:433] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-6a46c25fb679479183f9803a9ad3c0c0 on tablet 6a46c25fb679479183f9803a9ad3c0c0 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:18.772379 2113 raft_consensus.cc:1203] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:18.791643 2113 raft_consensus.cc:1203] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:18.864233 2113 raft_consensus.cc:1203] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:19.006995 2113 raft_consensus.cc:1203] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:19.204051 2275 raft_consensus.cc:1050] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:19.204752 2275 consensus_queue.cc:237] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.206704 1641 raft_consensus.cc:1261] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.206863 2113 raft_consensus.cc:1261] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.207255 1566 raft_consensus.cc:1261] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.207602 1745 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.207842 2196 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.208438 2196 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.214046 2275 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.214475 1566 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.220053 1387 catalog_manager.cc:5484] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:19.221242 1641 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.226361 2113 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.237733 1492 consensus_queue.cc:237] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.239189 2113 raft_consensus.cc:1261] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.239269 1566 raft_consensus.cc:1261] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.240154 2196 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.240397 2277 consensus_queue.cc:1035] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.242334 2275 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.242941 2113 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.243088 1566 raft_consensus.cc:2932] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.247651 1374 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 206e6477b3ef4f9a90696dadebc33275 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:19.247870 1390 catalog_manager.cc:5484] T 206e6477b3ef4f9a90696dadebc33275 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.251189 1625 tablet_service.cc:1514] Processing DeleteTablet for tablet 206e6477b3ef4f9a90696dadebc33275 with delete_type TABLET_DATA_TOMBSTONED (TS e3b9f2e003064a248d8822d0ea062b6b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47074
I20240501 20:12:19.263733 2285 tablet_replica.cc:330] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: stopping tablet replica
I20240501 20:12:19.263959 2285 raft_consensus.cc:2229] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:19.264225 2285 raft_consensus.cc:2258] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:19.265188 2285 ts_tablet_manager.cc:1875] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:19.271345 2285 ts_tablet_manager.cc:1888] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:19.271450 2285 log.cc:1196] T 206e6477b3ef4f9a90696dadebc33275 P e3b9f2e003064a248d8822d0ea062b6b: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root/wals/206e6477b3ef4f9a90696dadebc33275
I20240501 20:12:19.271991 1376 catalog_manager.cc:4830] TS e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): tablet 206e6477b3ef4f9a90696dadebc33275 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:19.309842 2274 raft_consensus.cc:1050] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:19.310654 2274 consensus_queue.cc:237] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.318236 2113 raft_consensus.cc:1261] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.318894 1489 raft_consensus.cc:1261] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.319114 2246 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.318236 1566 raft_consensus.cc:1261] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.319420 2274 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.319720 2236 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.324390 2236 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.329268 1566 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.330116 1389 catalog_manager.cc:5484] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:19.332522 2113 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.333866 1489 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.342120 1640 consensus_queue.cc:237] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.343688 1489 raft_consensus.cc:1261] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.343822 2113 raft_consensus.cc:1261] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.344204 2274 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.344441 2236 consensus_queue.cc:1035] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.346393 2246 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.346930 1492 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.349524 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b04ba7f3ce10406fb8c299b54fa3299b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:19.349725 2113 raft_consensus.cc:2932] T b04ba7f3ce10406fb8c299b54fa3299b P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.352610 1389 catalog_manager.cc:5484] T b04ba7f3ce10406fb8c299b54fa3299b P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:19.357332 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet b04ba7f3ce10406fb8c299b54fa3299b with delete_type TABLET_DATA_TOMBSTONED (TS ea4dd09ef4f040618fc481ba902e8726 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57588
I20240501 20:12:19.357987 2290 tablet_replica.cc:330] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: stopping tablet replica
I20240501 20:12:19.358238 2290 raft_consensus.cc:2229] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:19.358547 2290 raft_consensus.cc:2258] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:19.359383 2290 ts_tablet_manager.cc:1875] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:19.363957 2290 ts_tablet_manager.cc:1888] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:19.364058 2290 log.cc:1196] T b04ba7f3ce10406fb8c299b54fa3299b P ea4dd09ef4f040618fc481ba902e8726: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root/wals/b04ba7f3ce10406fb8c299b54fa3299b
I20240501 20:12:19.364703 1376 catalog_manager.cc:4830] TS ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): tablet b04ba7f3ce10406fb8c299b54fa3299b (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:19.382294 2236 raft_consensus.cc:1050] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:19.382983 2236 consensus_queue.cc:237] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.384766 2113 raft_consensus.cc:1261] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.384836 1566 raft_consensus.cc:1261] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.385035 1492 raft_consensus.cc:1261] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.385385 2292 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.385702 2236 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.386044 2246 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.390372 2246 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.390882 2113 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.395289 1492 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.396181 1388 catalog_manager.cc:5484] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.396158 1564 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.403182 2275 raft_consensus.cc:1050] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:19.403951 1640 consensus_queue.cc:237] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.403954 2275 consensus_queue.cc:237] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.405843 2113 raft_consensus.cc:1261] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.406212 2292 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.407923 2246 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.408528 2113 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.409478 1489 raft_consensus.cc:1261] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.410087 2292 consensus_queue.cc:1035] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.412273 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 880cb9bb122a4337bb96b871a9cef339 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:19.412377 1492 raft_consensus.cc:2932] T 880cb9bb122a4337bb96b871a9cef339 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.414587 1388 catalog_manager.cc:5484] T 880cb9bb122a4337bb96b871a9cef339 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:19.417963 2113 raft_consensus.cc:1261] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.418340 2196 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.420473 1640 raft_consensus.cc:1261] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.420610 1564 raft_consensus.cc:1261] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:19.421128 2275 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.422602 2196 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:19.425572 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet 880cb9bb122a4337bb96b871a9cef339 with delete_type TABLET_DATA_TOMBSTONED (TS ea4dd09ef4f040618fc481ba902e8726 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57588
I20240501 20:12:19.425901 2290 tablet_replica.cc:330] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: stopping tablet replica
I20240501 20:12:19.426086 2290 raft_consensus.cc:2229] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:19.426329 2290 raft_consensus.cc:2258] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:19.427163 2290 ts_tablet_manager.cc:1875] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:19.430770 2196 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.432566 2290 ts_tablet_manager.cc:1888] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:19.432658 2290 log.cc:1196] T 880cb9bb122a4337bb96b871a9cef339 P ea4dd09ef4f040618fc481ba902e8726: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root/wals/880cb9bb122a4337bb96b871a9cef339
I20240501 20:12:19.433210 1376 catalog_manager.cc:4830] TS ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): tablet 880cb9bb122a4337bb96b871a9cef339 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:19.434151 1566 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.435158 1641 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.435751 2113 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.436005 1388 catalog_manager.cc:5484] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:19.446723 1492 consensus_queue.cc:237] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:19.448020 2113 raft_consensus.cc:1261] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.448429 2277 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.448520 1566 raft_consensus.cc:1261] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:19.449108 2277 consensus_queue.cc:1035] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:19.450381 2277 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.451977 1566 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.453734 1374 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6a46c25fb679479183f9803a9ad3c0c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:19.453437 2113 raft_consensus.cc:2932] T 6a46c25fb679479183f9803a9ad3c0c0 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:19.457983 1388 catalog_manager.cc:5484] T 6a46c25fb679479183f9803a9ad3c0c0 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:19.462945 1625 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a46c25fb679479183f9803a9ad3c0c0 with delete_type TABLET_DATA_TOMBSTONED (TS e3b9f2e003064a248d8822d0ea062b6b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47074
I20240501 20:12:19.463375 2285 tablet_replica.cc:330] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: stopping tablet replica
I20240501 20:12:19.463544 2285 raft_consensus.cc:2229] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:19.463738 2285 raft_consensus.cc:2258] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:19.464365 2285 ts_tablet_manager.cc:1875] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:19.468976 2285 ts_tablet_manager.cc:1888] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:19.469095 2285 log.cc:1196] T 6a46c25fb679479183f9803a9ad3c0c0 P e3b9f2e003064a248d8822d0ea062b6b: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root/wals/6a46c25fb679479183f9803a9ad3c0c0
I20240501 20:12:19.469684 1376 catalog_manager.cc:4830] TS e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): tablet 6a46c25fb679479183f9803a9ad3c0c0 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:20.472553 1566 consensus_queue.cc:237] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:20.474756 1641 raft_consensus.cc:1261] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 20:12:20.475080 1532 consensus_peers.cc:485] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c353b8338de4b3b9f7b3d0f268e5577. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:20.474808 1492 raft_consensus.cc:1261] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:20.475476 2302 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:20.475751 2303 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:20.478086 2219 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.478727 1492 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.478726 1641 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.482422 1640 consensus_queue.cc:237] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:20.483280 1390 catalog_manager.cc:5484] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240501 20:12:20.488464 1606 consensus_peers.cc:485] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 500fba598d2e4c858888998c3e3d2080. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:20.488692 1566 raft_consensus.cc:1261] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:20.488963 1492 raft_consensus.cc:1261] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:20.489446 2292 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:20.489656 2236 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:20.491958 2292 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.492731 1566 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.499939 1389 catalog_manager.cc:5484] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.506105 1492 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.506660 1640 consensus_queue.cc:237] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
W20240501 20:12:20.509678 1606 consensus_peers.cc:485] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbe80020f28649a79752351baff072a2. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:20.510012 1488 raft_consensus.cc:1261] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:20.510546 1566 raft_consensus.cc:1261] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:20.510510 2292 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:20.511101 2292 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:20.513654 2312 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.514292 1488 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.514926 1566 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.519232 1492 consensus_queue.cc:237] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:20.519767 1389 catalog_manager.cc:5484] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.521783 1566 raft_consensus.cc:1261] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:20.522500 2320 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 20:12:20.522832 1457 consensus_peers.cc:485] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f37d944d0d844828f7d97eeac371d0a. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:20.522907 1640 raft_consensus.cc:1261] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:20.523356 1745 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:20.526371 1745 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.526998 1640 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.534631 1388 catalog_manager.cc:5484] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 20:12:20.534979 1564 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:20.930699 2323 ts_tablet_manager.cc:902] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:20.931986 2323 tablet_copy_client.cc:308] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.3:44359
I20240501 20:12:20.932511 1650 tablet_copy_service.cc:140] P e3b9f2e003064a248d8822d0ea062b6b: Received BeginTabletCopySession request for tablet fbe80020f28649a79752351baff072a2 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:33516)
I20240501 20:12:20.932619 1650 tablet_copy_service.cc:161] P e3b9f2e003064a248d8822d0ea062b6b: Beginning new tablet copy session on tablet fbe80020f28649a79752351baff072a2 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:33516: session id = d79f04148ddc45aea5b7eef7087a6631-fbe80020f28649a79752351baff072a2
I20240501 20:12:20.934706 1650 tablet_copy_source_session.cc:205] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:20.935649 2323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbe80020f28649a79752351baff072a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:20.941076 2323 tablet_copy_client.cc:783] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:20.941282 2323 tablet_copy_client.cc:647] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:20.942565 2323 tablet_copy_client.cc:523] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:20.946038 2323 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:20.950779 2323 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:20.951085 2323 tablet_bootstrap.cc:492] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:20.951287 2323 ts_tablet_manager.cc:1367] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20240501 20:12:20.951946 2323 raft_consensus.cc:348] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:20.952106 2323 raft_consensus.cc:729] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:20.952265 2323 consensus_queue.cc:260] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:20.953459 2323 ts_tablet_manager.cc:1398] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240501 20:12:20.953948 1650 tablet_copy_service.cc:342] P e3b9f2e003064a248d8822d0ea062b6b: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-fbe80020f28649a79752351baff072a2 received from {username='slave'} at 127.0.0.1:33516
I20240501 20:12:20.954047 1650 tablet_copy_service.cc:433] P e3b9f2e003064a248d8822d0ea062b6b: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-fbe80020f28649a79752351baff072a2 on tablet fbe80020f28649a79752351baff072a2 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:21.037631 2323 ts_tablet_manager.cc:902] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831)
I20240501 20:12:21.038827 2323 tablet_copy_client.cc:308] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.1:44831
I20240501 20:12:21.039415 1502 tablet_copy_service.cc:140] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Received BeginTabletCopySession request for tablet 4f37d944d0d844828f7d97eeac371d0a from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:37784)
I20240501 20:12:21.039551 1502 tablet_copy_service.cc:161] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Beginning new tablet copy session on tablet 4f37d944d0d844828f7d97eeac371d0a from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:37784: session id = d79f04148ddc45aea5b7eef7087a6631-4f37d944d0d844828f7d97eeac371d0a
I20240501 20:12:21.041909 1502 tablet_copy_source_session.cc:205] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:21.042920 2323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f37d944d0d844828f7d97eeac371d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:21.047784 2323 tablet_copy_client.cc:783] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:21.047994 2323 tablet_copy_client.cc:647] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:21.049226 2323 tablet_copy_client.cc:523] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:21.051893 2323 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:21.057228 2323 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:21.057539 2323 tablet_bootstrap.cc:492] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:21.057773 2323 ts_tablet_manager.cc:1367] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.006s user 0.008s sys 0.000s
I20240501 20:12:21.058444 2323 raft_consensus.cc:348] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:21.058656 2323 raft_consensus.cc:729] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:21.058840 2323 consensus_queue.cc:260] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:21.059983 2323 ts_tablet_manager.cc:1398] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 20:12:21.060493 1502 tablet_copy_service.cc:342] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-4f37d944d0d844828f7d97eeac371d0a received from {username='slave'} at 127.0.0.1:37784
I20240501 20:12:21.060585 1502 tablet_copy_service.cc:433] P d7a3dc5590604ae1ba6e4b2a81ad1ae6: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-4f37d944d0d844828f7d97eeac371d0a on tablet 4f37d944d0d844828f7d97eeac371d0a with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:21.079279 2323 ts_tablet_manager.cc:902] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
I20240501 20:12:21.081601 2323 tablet_copy_client.cc:308] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.3:44359
I20240501 20:12:21.082157 1650 tablet_copy_service.cc:140] P e3b9f2e003064a248d8822d0ea062b6b: Received BeginTabletCopySession request for tablet 500fba598d2e4c858888998c3e3d2080 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:33516)
I20240501 20:12:21.082283 1650 tablet_copy_service.cc:161] P e3b9f2e003064a248d8822d0ea062b6b: Beginning new tablet copy session on tablet 500fba598d2e4c858888998c3e3d2080 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:33516: session id = d79f04148ddc45aea5b7eef7087a6631-500fba598d2e4c858888998c3e3d2080
I20240501 20:12:21.085358 1650 tablet_copy_source_session.cc:205] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:21.086486 2323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 500fba598d2e4c858888998c3e3d2080. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:21.091296 2323 tablet_copy_client.cc:783] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:21.091486 2323 tablet_copy_client.cc:647] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:21.093120 2323 tablet_copy_client.cc:523] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:21.093596 2339 ts_tablet_manager.cc:902] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033)
I20240501 20:12:21.095152 2339 tablet_copy_client.cc:308] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Beginning tablet copy session from remote peer at address 127.0.100.2:35033
I20240501 20:12:21.095672 1577 tablet_copy_service.cc:140] P ea4dd09ef4f040618fc481ba902e8726: Received BeginTabletCopySession request for tablet 4c353b8338de4b3b9f7b3d0f268e5577 from peer d79f04148ddc45aea5b7eef7087a6631 ({username='slave'} at 127.0.0.1:55436)
I20240501 20:12:21.095788 1577 tablet_copy_service.cc:161] P ea4dd09ef4f040618fc481ba902e8726: Beginning new tablet copy session on tablet 4c353b8338de4b3b9f7b3d0f268e5577 from peer d79f04148ddc45aea5b7eef7087a6631 at {username='slave'} at 127.0.0.1:55436: session id = d79f04148ddc45aea5b7eef7087a6631-4c353b8338de4b3b9f7b3d0f268e5577
I20240501 20:12:21.097535 2323 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:21.098533 1577 tablet_copy_source_session.cc:205] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 20:12:21.099839 2339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c353b8338de4b3b9f7b3d0f268e5577. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:12:21.103288 2323 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:21.103659 2323 tablet_bootstrap.cc:492] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:21.103863 2323 ts_tablet_manager.cc:1367] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240501 20:12:21.104571 2323 raft_consensus.cc:348] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:21.104784 2323 raft_consensus.cc:729] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:21.104960 2323 consensus_queue.cc:260] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:21.105531 2323 ts_tablet_manager.cc:1398] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240501 20:12:21.105649 2339 tablet_copy_client.cc:783] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 0 data blocks...
I20240501 20:12:21.105832 2339 tablet_copy_client.cc:647] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Starting download of 1 WAL segments...
I20240501 20:12:21.106127 1650 tablet_copy_service.cc:342] P e3b9f2e003064a248d8822d0ea062b6b: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-500fba598d2e4c858888998c3e3d2080 received from {username='slave'} at 127.0.0.1:33516
I20240501 20:12:21.106226 1650 tablet_copy_service.cc:433] P e3b9f2e003064a248d8822d0ea062b6b: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-500fba598d2e4c858888998c3e3d2080 on tablet 500fba598d2e4c858888998c3e3d2080 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:21.107183 2339 tablet_copy_client.cc:523] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 20:12:21.110226 2339 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap starting.
I20240501 20:12:21.115449 2339 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 20:12:21.115741 2339 tablet_bootstrap.cc:492] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: Bootstrap complete.
I20240501 20:12:21.115926 2339 ts_tablet_manager.cc:1367] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20240501 20:12:21.116509 2339 raft_consensus.cc:348] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:21.116658 2339 raft_consensus.cc:729] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d79f04148ddc45aea5b7eef7087a6631, State: Initialized, Role: LEARNER
I20240501 20:12:21.116794 2339 consensus_queue.cc:260] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:21.117352 2339 ts_tablet_manager.cc:1398] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631: Time spent starting tablet: real 0.001s user 0.002s sys 0.001s
I20240501 20:12:21.117924 1577 tablet_copy_service.cc:342] P ea4dd09ef4f040618fc481ba902e8726: Request end of tablet copy session d79f04148ddc45aea5b7eef7087a6631-4c353b8338de4b3b9f7b3d0f268e5577 received from {username='slave'} at 127.0.0.1:55436
I20240501 20:12:21.117995 1577 tablet_copy_service.cc:433] P ea4dd09ef4f040618fc481ba902e8726: ending tablet copy session d79f04148ddc45aea5b7eef7087a6631-4c353b8338de4b3b9f7b3d0f268e5577 on tablet 4c353b8338de4b3b9f7b3d0f268e5577 with peer d79f04148ddc45aea5b7eef7087a6631
I20240501 20:12:21.429673 2113 raft_consensus.cc:1203] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:21.594688 2113 raft_consensus.cc:1203] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:21.624601 2113 raft_consensus.cc:1203] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:21.678206 2113 raft_consensus.cc:1203] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 20:12:21.897517 2315 raft_consensus.cc:1050] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:21.898151 2315 consensus_queue.cc:237] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:21.900372 2113 raft_consensus.cc:1261] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:21.900523 1492 raft_consensus.cc:1261] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:21.900707 1566 raft_consensus.cc:1261] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:21.900818 2315 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:21.901074 2346 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:21.901355 2312 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:21.904947 2346 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.905848 1492 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.909112 1566 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.909112 2113 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.913738 1390 catalog_manager.cc:5484] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.928361 1641 consensus_queue.cc:237] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:21.929814 2113 raft_consensus.cc:1261] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:21.929932 1492 raft_consensus.cc:1261] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:21.930442 2346 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:21.930691 2312 consensus_queue.cc:1035] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:21.932787 2346 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.933627 1488 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.933574 2113 raft_consensus.cc:2932] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.938457 1387 catalog_manager.cc:5484] T fbe80020f28649a79752351baff072a2 P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 3 to 4, VOTER ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2) evicted. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:21.940176 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fbe80020f28649a79752351baff072a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:21.942101 1554 tablet_service.cc:1514] Processing DeleteTablet for tablet fbe80020f28649a79752351baff072a2 with delete_type TABLET_DATA_TOMBSTONED (TS ea4dd09ef4f040618fc481ba902e8726 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57588
I20240501 20:12:21.942680 2359 tablet_replica.cc:330] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: stopping tablet replica
I20240501 20:12:21.942850 2359 raft_consensus.cc:2229] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:21.943089 2359 raft_consensus.cc:2258] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:21.943861 2359 ts_tablet_manager.cc:1875] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:21.948907 2359 ts_tablet_manager.cc:1888] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:21.948987 2359 log.cc:1196] T fbe80020f28649a79752351baff072a2 P ea4dd09ef4f040618fc481ba902e8726: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-1-root/wals/fbe80020f28649a79752351baff072a2
I20240501 20:12:21.949617 1376 catalog_manager.cc:4830] TS ea4dd09ef4f040618fc481ba902e8726 (127.0.100.2:35033): tablet fbe80020f28649a79752351baff072a2 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:22.015000 2320 raft_consensus.cc:1050] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:22.015587 2320 consensus_queue.cc:237] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:22.017549 2113 raft_consensus.cc:1261] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.018028 2277 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.018154 1566 raft_consensus.cc:1261] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.018154 1641 raft_consensus.cc:1261] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.018770 2347 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.019246 2347 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.023087 2361 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.023594 2113 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.028942 1389 catalog_manager.cc:5484] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.031548 1641 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.033658 1566 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.040194 1492 consensus_queue.cc:237] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:22.041760 2113 raft_consensus.cc:1261] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:22.041810 1566 raft_consensus.cc:1261] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:22.042171 2361 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:22.042418 2277 consensus_queue.cc:1035] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:22.044306 2277 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.044890 1563 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.046834 2113 raft_consensus.cc:2932] T 4f37d944d0d844828f7d97eeac371d0a P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.049261 1374 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 4f37d944d0d844828f7d97eeac371d0a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:22.050539 1387 catalog_manager.cc:5484] T 4f37d944d0d844828f7d97eeac371d0a P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index 3 to 4, VOTER e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3) evicted. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:22.053831 1625 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f37d944d0d844828f7d97eeac371d0a with delete_type TABLET_DATA_TOMBSTONED (TS e3b9f2e003064a248d8822d0ea062b6b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47074
I20240501 20:12:22.054476 2365 tablet_replica.cc:330] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: stopping tablet replica
I20240501 20:12:22.054641 2365 raft_consensus.cc:2229] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:22.054867 2365 raft_consensus.cc:2258] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:22.055801 2365 ts_tablet_manager.cc:1875] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:22.058180 2354 raft_consensus.cc:1050] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:22.058887 2354 consensus_queue.cc:237] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:22.061544 2113 raft_consensus.cc:1261] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.062028 2365 ts_tablet_manager.cc:1888] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:22.062134 2365 log.cc:1196] T 4f37d944d0d844828f7d97eeac371d0a P e3b9f2e003064a248d8822d0ea062b6b: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-2-root/wals/4f37d944d0d844828f7d97eeac371d0a
I20240501 20:12:22.062278 1492 raft_consensus.cc:1261] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.062484 1566 raft_consensus.cc:1261] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.062713 1376 catalog_manager.cc:4830] TS e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359): tablet 4f37d944d0d844828f7d97eeac371d0a (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:22.062798 2315 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.063184 2346 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.063432 2312 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.067703 2315 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.068380 1566 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.068734 1492 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.074280 1387 catalog_manager.cc:5484] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.074211 2113 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.079466 1640 consensus_queue.cc:237] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:22.081037 2113 raft_consensus.cc:1261] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:22.081487 2354 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:22.082906 1566 raft_consensus.cc:1261] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:22.083509 2354 consensus_queue.cc:1035] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:22.083961 2354 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.085358 2113 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.087014 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 500fba598d2e4c858888998c3e3d2080 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:22.089143 1390 catalog_manager.cc:5484] T 500fba598d2e4c858888998c3e3d2080 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:22.089457 1566 raft_consensus.cc:2932] T 500fba598d2e4c858888998c3e3d2080 P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.092856 1475 tablet_service.cc:1514] Processing DeleteTablet for tablet 500fba598d2e4c858888998c3e3d2080 with delete_type TABLET_DATA_TOMBSTONED (TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42562
I20240501 20:12:22.093665 2370 tablet_replica.cc:330] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: stopping tablet replica
I20240501 20:12:22.093854 2370 raft_consensus.cc:2229] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:22.094151 2370 raft_consensus.cc:2258] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:22.095916 2370 ts_tablet_manager.cc:1875] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:22.101190 2370 ts_tablet_manager.cc:1888] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:22.101292 2370 log.cc:1196] T 500fba598d2e4c858888998c3e3d2080 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root/wals/500fba598d2e4c858888998c3e3d2080
I20240501 20:12:22.101846 1374 catalog_manager.cc:4830] TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): tablet 500fba598d2e4c858888998c3e3d2080 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:22.295203 2349 raft_consensus.cc:1050] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726: attempting to promote NON_VOTER d79f04148ddc45aea5b7eef7087a6631 to VOTER
I20240501 20:12:22.295884 2349 consensus_queue.cc:237] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:22.297822 2113 raft_consensus.cc:1261] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [term 1 LEARNER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.298462 1641 raft_consensus.cc:1261] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.298434 2371 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.299012 2371 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.310176 2371 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.310982 1640 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.311607 1492 raft_consensus.cc:1261] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 20:12:22.312058 2376 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 20:12:22.315022 2113 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.316581 1388 catalog_manager.cc:5484] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 20:12:22.317852 1492 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.322013 1563 consensus_queue.cc:237] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } }
I20240501 20:12:22.325537 1640 raft_consensus.cc:1261] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:22.325965 2113 raft_consensus.cc:1261] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 20:12:22.326121 2349 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:22.327399 2349 consensus_queue.cc:1035] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 20:12:22.328474 2371 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.329202 1640 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.331368 1376 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 4c353b8338de4b3b9f7b3d0f268e5577 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 20:12:22.333658 1390 catalog_manager.cc:5484] T 4c353b8338de4b3b9f7b3d0f268e5577 P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.335623 2113 raft_consensus.cc:2932] T 4c353b8338de4b3b9f7b3d0f268e5577 P d79f04148ddc45aea5b7eef7087a6631 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: false } } }
I20240501 20:12:22.337181 1475 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c353b8338de4b3b9f7b3d0f268e5577 with delete_type TABLET_DATA_TOMBSTONED (TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42562
I20240501 20:12:22.337468 2370 tablet_replica.cc:330] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: stopping tablet replica
I20240501 20:12:22.337642 2370 raft_consensus.cc:2229] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 20:12:22.337821 2370 raft_consensus.cc:2258] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 20:12:22.338554 2370 ts_tablet_manager.cc:1875] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 20:12:22.343921 2370 ts_tablet_manager.cc:1888] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 20:12:22.344005 2370 log.cc:1196] T 4c353b8338de4b3b9f7b3d0f268e5577 P d7a3dc5590604ae1ba6e4b2a81ad1ae6: Deleting WAL directory at /tmp/dist-test-taskRhwqoG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714594276349076-400-0/minicluster-data/ts-0-root/wals/4c353b8338de4b3b9f7b3d0f268e5577
I20240501 20:12:22.344506 1374 catalog_manager.cc:4830] TS d7a3dc5590604ae1ba6e4b2a81ad1ae6 (127.0.100.1:44831): tablet 4c353b8338de4b3b9f7b3d0f268e5577 (table test-workload [id=8fa1dedbc0ab4f83a1f06fdfebb0001a]) successfully deleted
I20240501 20:12:23.351068 1640 consensus_queue.cc:237] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:23.352916 1488 raft_consensus.cc:1261] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 20:12:23.352990 1606 consensus_peers.cc:485] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f379c9b447af4fb29e6081a1f9e901ec. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:23.353163 1563 raft_consensus.cc:1261] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer e3b9f2e003064a248d8822d0ea062b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:23.353415 2315 consensus_queue.cc:1035] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.353691 2380 consensus_queue.cc:1035] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.355659 2315 raft_consensus.cc:2932] T f379c9b447af4fb29e6081a1f9e901ec P e3b9f2e003064a248d8822d0ea062b6b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.356855 1563 raft_consensus.cc:2932] T f379c9b447af4fb29e6081a1f9e901ec P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.357288 1488 raft_consensus.cc:2932] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.360819 1566 consensus_queue.cc:237] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:23.362287 1387 catalog_manager.cc:5484] T f379c9b447af4fb29e6081a1f9e901ec P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "e3b9f2e003064a248d8822d0ea062b6b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } attrs { replace: true } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.373605 1488 raft_consensus.cc:1261] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 20:12:23.373693 1532 consensus_peers.cc:485] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 704a5fa4f8fa467b935ebe6c1bdf79a3. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:23.373992 1641 raft_consensus.cc:1261] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:23.374029 2373 consensus_queue.cc:1035] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.374352 2389 consensus_queue.cc:1035] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.376678 2373 raft_consensus.cc:2932] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.377269 1488 raft_consensus.cc:2932] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.381217 1641 raft_consensus.cc:2932] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.382377 1388 catalog_manager.cc:5484] T 704a5fa4f8fa467b935ebe6c1bdf79a3 P d7a3dc5590604ae1ba6e4b2a81ad1ae6 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.384716 1566 consensus_queue.cc:237] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:23.386914 1488 raft_consensus.cc:1261] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:23.387547 2378 consensus_queue.cc:1035] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.387784 1641 raft_consensus.cc:1261] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer ea4dd09ef4f040618fc481ba902e8726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 20:12:23.387792 1532 consensus_peers.cc:485] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 802bbe84710b48be9d9ee6a15279ff9b. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:23.388270 2378 consensus_queue.cc:1035] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.390444 2373 raft_consensus.cc:2932] T 802bbe84710b48be9d9ee6a15279ff9b P ea4dd09ef4f040618fc481ba902e8726 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.391356 1640 raft_consensus.cc:2932] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.396781 1387 catalog_manager.cc:5484] T 802bbe84710b48be9d9ee6a15279ff9b P e3b9f2e003064a248d8822d0ea062b6b reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "ea4dd09ef4f040618fc481ba902e8726" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.397024 1492 consensus_queue.cc:237] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } }
I20240501 20:12:23.399200 1640 raft_consensus.cc:1261] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 20:12:23.399356 1566 raft_consensus.cc:1261] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Refusing update from remote peer d7a3dc5590604ae1ba6e4b2a81ad1ae6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 20:12:23.399461 1457 consensus_peers.cc:485] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 -> Peer d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4:39911): Couldn't send request to peer d79f04148ddc45aea5b7eef7087a6631. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a961f26ce8d04b78a0e7d25fe8bbdfeb. This is attempt 1: this message will repeat every 5th retry.
I20240501 20:12:23.399960 2396 consensus_queue.cc:1035] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.400276 2361 consensus_queue.cc:1035] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 20:12:23.403656 2396 raft_consensus.cc:2932] T a961f26ce8d04b78a0e7d25fe8bbdfeb P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.404222 1566 raft_consensus.cc:2932] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.404793 1488 raft_consensus.cc:2932] T 802bbe84710b48be9d9ee6a15279ff9b P d7a3dc5590604ae1ba6e4b2a81ad1ae6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } attrs { replace: true } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.410905 1390 catalog_manager.cc:5484] T a961f26ce8d04b78a0e7d25fe8bbdfeb P ea4dd09ef4f040618fc481ba902e8726 reported cstate change: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New cstate: current_term: 1 leader_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.416000 1640 raft_consensus.cc:2932] T a961f26ce8d04b78a0e7d25fe8bbdfeb P e3b9f2e003064a248d8822d0ea062b6b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d79f04148ddc45aea5b7eef7087a6631 (127.0.100.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "d7a3dc5590604ae1ba6e4b2a81ad1ae6" member_type: VOTER last_known_addr { host: "127.0.100.1" port: 44831 } } peers { permanent_uuid: "ea4dd09ef4f040618fc481ba902e8726" member_type: VOTER last_known_addr { host: "127.0.100.2" port: 35033 } } peers { permanent_uuid: "e3b9f2e003064a248d8822d0ea062b6b" member_type: VOTER last_known_addr { host: "127.0.100.3" port: 44359 } attrs { replace: true } } peers { permanent_uuid: "d79f04148ddc45aea5b7eef7087a6631" member_type: NON_VOTER last_known_addr { host: "127.0.100.4" port: 39911 } attrs { promote: true } } }
I20240501 20:12:23.779593 2399 ts_tablet_manager.cc:902] T f379c9b447af4fb29e6081a1f9e901ec P d79f04148ddc45aea5b7eef7087a6631: Initiating tablet copy from peer e3b9f2e003064a248d8822d0ea062b6b (127.0.100.3:44359)
F20240501 20:12:23.780036 2399 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-206e6477b3ef4f9a90696dadebc33275.queue_time_us, tablet-download-pool-206e6477b3ef4f9a90696dadebc33275.queue_time_us) (tablet-download-pool-206e6477b3ef4f9a90696dadebc33275.run_cpu_time_us, tablet-download-pool-206e6477b3ef4f9a90696dadebc33275.run_cpu_time_us) (tablet-download-pool-206e6477b3ef4f9a90696dadebc33275.run_wall_time_us, tablet-download-pool-206e6477b3ef4f9a90696dadebc33275.run_wall_time_us) (tablet-download-pool-32b168a9a8104ccbab55dfc28be4a612.queue_time_us, tablet-download-pool-32b168a9a8104ccbab55dfc28be4a612.queue_time_us) (tablet-download-pool-32b168a9a8104ccbab55dfc28be4a612.run_cpu_time_us, tablet-download-pool-32b168a9a8104ccbab55dfc28be4a612.run_cpu_time_us) (tablet-download-pool-32b168a9a8104ccbab55dfc28be4a612.run_wall_time_us, tablet-download-pool-32b168a9a8104ccbab55dfc28be4a612.run_wall_time_us) (tablet-download-pool-4c353b8338de4b3b9f7b3d0f268e5577.queue_time_us, tablet-download-pool-4c353b8338de4b3b9f7b3d0f268e5577.queue_time_us) (tablet-download-pool-4c353b8338de4b3b9f7b3d0f268e5577.run_cpu_time_us, tablet-download-pool-4c353b8338de4b3b9f7b3d0f268e5577.run_cpu_time_us) (tablet-download-pool-4c353b8338de4b3b9f7b3d0f268e5577.run_wall_time_us, tablet-download-pool-4c353b8338de4b3b9f7b3d0f268e5577.run_wall_time_us) (tablet-download-pool-4f37d944d0d844828f7d97eeac371d0a.queue_time_us, tablet-download-pool-4f37d944d0d844828f7d97eeac371d0a.queue_time_us) (tablet-download-pool-4f37d944d0d844828f7d97eeac371d0a.run_cpu_time_us, tablet-download-pool-4f37d944d0d844828f7d97eeac371d0a.run_cpu_time_us) (tablet-download-pool-4f37d944d0d844828f7d97eeac371d0a.run_wall_time_us, tablet-download-pool-4f37d944d0d844828f7d97eeac371d0a.run_wall_time_us) (tablet-download-pool-500fba598d2e4c858888998c3e3d2080.queue_time_us, tablet-download-pool-500fba598d2e4c858888998c3e3d2080.queue_time_us) (tablet-download-pool-500fba598d2e4c858888998c3e3d2080.run_cpu_time_us, tablet-download-pool-500fba598d2e4c858888998c3e3d2080.run_cpu_time_us) (tablet-download-pool-500fba598d2e4c858888998c3e3d2080.run_wall_time_us, tablet-download-pool-500fba598d2e4c858888998c3e3d2080.run_wall_time_us) (tablet-download-pool-6a46c25fb679479183f9803a9ad3c0c0.queue_time_us, tablet-download-pool-6a46c25fb679479183f9803a9ad3c0c0.queue_time_us) (tablet-download-pool-6a46c25fb679479183f9803a9ad3c0c0.run_cpu_time_us, tablet-download-pool-6a46c25fb679479183f9803a9ad3c0c0.run_cpu_time_us) (tablet-download-pool-6a46c25fb679479183f9803a9ad3c0c0.run_wall_time_us, tablet-download-pool-6a46c25fb679479183f9803a9ad3c0c0.run_wall_time_us) (tablet-download-pool-880cb9bb122a4337bb96b871a9cef339.queue_time_us, tablet-download-pool-880cb9bb122a4337bb96b871a9cef339.queue_time_us) (tablet-download-pool-880cb9bb122a4337bb96b871a9cef339.run_cpu_time_us, tablet-download-pool-880cb9bb122a4337bb96b871a9cef339.run_cpu_time_us) (tablet-download-pool-880cb9bb122a4337bb96b871a9cef339.run_wall_time_us, tablet-download-pool-880cb9bb122a4337bb96b871a9cef339.run_wall_time_us) (tablet-download-pool-b04ba7f3ce10406fb8c299b54fa3299b.queue_time_us, tablet-download-pool-b04ba7f3ce10406fb8c299b54fa3299b.queue_time_us) (tablet-download-pool-b04ba7f3ce10406fb8c299b54fa3299b.run_cpu_time_us, tablet-download-pool-b04ba7f3ce10406fb8c299b54fa3299b.run_cpu_time_us) (tablet-download-pool-b04ba7f3ce10406fb8c299b54fa3299b.run_wall_time_us, tablet-download-pool-b04ba7f3ce10406fb8c299b54fa3299b.run_wall_time_us) (tablet-download-pool-c88aa6fcedc6495ba20b1e5a5a59a554.queue_time_us, tablet-download-pool-c88aa6fcedc6495ba20b1e5a5a59a554.queue_time_us) (tablet-download-pool-c88aa6fcedc6495ba20b1e5a5a59a554.run_cpu_time_us, tablet-download-pool-c88aa6fcedc6495ba20b1e5a5a59a554.run_cpu_time_us) (tablet-download-pool-c88aa6fcedc6495ba20b1e5a5a59a554.run_wall_time_us, tablet-download-pool-c88aa6fcedc6495ba20b1e5a5a59a554.run_wall_time_us) (tablet-download-pool-e68951f3197141fabb5828e9e87545a8.queue_time_us, tablet-download-pool-e68951f3197141fabb5828e9e87545a8.queue_time_us) (tablet-download-pool-e68951f3197141fabb5828e9e87545a8.run_cpu_time_us, tablet-download-pool-e68951f3197141fabb5828e9e87545a8.run_cpu_time_us) (tablet-download-pool-e68951f3197141fabb5828e9e87545a8.run_wall_time_us, tablet-download-pool-e68951f3197141fabb5828e9e87545a8.run_wall_time_us) (tablet-download-pool-f379c9b447af4fb29e6081a1f9e901ec.queue_time_us, tablet-download-pool-f379c9b447af4fb29e6081a1f9e901ec.queue_time_us) (tablet-download-pool-f46990a85ef946b0b40127c23e2696e9.queue_time_us, tablet-download-pool-f46990a85ef946b0b40127c23e2696e9.queue_time_us) (tablet-download-pool-f46990a85ef946b0b40127c23e2696e9.run_cpu_time_us, tablet-download-pool-f46990a85ef946b0b40127c23e2696e9.run_cpu_time_us) (tablet-download-pool-f46990a85ef946b0b40127c23e2696e9.run_wall_time_us, tablet-download-pool-f46990a85ef946b0b40127c23e2696e9.run_wall_time_us) (tablet-download-pool-fbe80020f28649a79752351baff072a2.queue_time_us, tablet-download-pool-fbe80020f28649a79752351baff072a2.queue_time_us) (tablet-download-pool-fbe80020f28649a79752351baff072a2.run_cpu_time_us, tablet-download-pool-fbe80020f28649a79752351baff072a2.run_cpu_time_us) (tablet-download-pool-fbe80020f28649a79752351baff072a2.run_wall_time_us, tablet-download-pool-fbe80020f28649a79752351baff072a2.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714594343 (unix time) try "date -d @1714594343" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000190) received by PID 400 (TID 0x7f103b1ce700) from PID 400; stack trace: ***
@ 0x7f10ec083980 (unknown) at ??:0
@ 0x7f10e13d0fb7 gsignal at ??:0
@ 0x7f10e13d2921 abort at ??:0
@ 0x7f10e3e85dcd google::LogMessage::Fail() at ??:0
@ 0x7f10e3e89b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f10e3e857cc google::LogMessage::Flush() at ??:0
@ 0x7f10e3e86f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f10e5502742 kudu::TraceMetrics::InternName() at ??:0
@ 0x7f10e54cef8b kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7f10e54c8cd6 kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7f10f49948de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7f10f49acdaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7f10f4ad7480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7f10f4b0fa8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7f10f4af2981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7f10f4af270e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f10f999498d std::function<>::operator()() at ??:0
@ 0x7f10e54d2b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f10e54d619c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f10e54d6019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f10f999498d std::function<>::operator()() at ??:0
@ 0x7f10e54b101e kudu::Thread::SuperviseThread() at ??:0
@ 0x7f10ec0786db start_thread at ??:0
@ 0x7f10e14b371f clone at ??:0